Jun 24 04:06:22 devstack cinder-volume[82483]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 24 04:06:22 devstack cinder-volume[82483]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:06:22 devstack cinder-volume[82483]: we strongly recommend against using it for new projects.
Jun 24 04:06:22 devstack cinder-volume[82483]: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:06:22 devstack cinder-volume[82483]: framework.  For more detail see
Jun 24 04:06:22 devstack cinder-volume[82483]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:06:22 devstack cinder-volume[82483]:   import eventlet  # noqa
Jun 24 04:06:25 devstack cinder-volume[82483]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:06:25 devstack cinder-volume[82483]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:06:25 devstack cinder-volume[82483]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:06:25 devstack cinder-volume[82483]: INFO dbcounter [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Registered counter for database cinder
Jun 24 04:06:26 devstack cinder-volume[82483]: DEBUG oslo_db.sqlalchemy.engines [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:06:26 devstack cinder-volume[82483]: DEBUG dbcounter [-] [82483] Writer thread running {{(pid=82483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:06:26 devstack cinder-volume[82483]: INFO cinder.rpc [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 24 04:06:26 devstack cinder-volume[82483]: INFO cinder.rpc [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 24 04:06:26 devstack cinder-volume[82483]: DEBUG oslo_db.sqlalchemy.engines [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:06:26 devstack cinder-volume[82483]: INFO cinder.volume.manager [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Determined volume DB was empty at startup.
Jun 24 04:06:26 devstack cinder-volume[82483]: DEBUG cinder.volume.manager [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82483) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 24 04:06:26 devstack cinder-volume[82483]: INFO cinder.volume.manager [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 24 04:06:26 devstack cinder-volume[82483]: WARNING stevedore.named [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 24 04:06:26 devstack cinder-volume[82483]: WARNING castellan.key_manager [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:06:26 devstack cinder-volume[82483]: WARNING cinder.keymgr.conf_key_mgr [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:06:26 devstack cinder-volume[82483]: DEBUG cinder.volume.drivers.lvm [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82483) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 24 04:06:26 devstack cinder-volume[82483]: DEBUG oslo_concurrency.processutils [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_concurrency.processutils [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=82483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_db.sqlalchemy.engines [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:06:27 devstack cinder-volume[82483]: INFO cinder.rpc [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 24 04:06:27 devstack cinder-volume[82483]: INFO cinder.rpc [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 24 04:06:27 devstack cinder-volume[82483]: WARNING stevedore.named [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 24 04:06:27 devstack cinder-volume[82483]: WARNING castellan.key_manager [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:06:27 devstack cinder-volume[82483]: INFO cinder.volume.manager [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_db.sqlalchemy.engines [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:06:27 devstack cinder-volume[82483]: INFO oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Starting 1 workers
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Started child 82656 {{(pid=82483) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Full set of CONF: {{(pid=82483) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] ******************************************************************************** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Configuration options gathered from: {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] ================================================================================ {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] allow_availability_zone_fallback = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] allow_compression_on_image_upload = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] allowed_direct_url_schemes     = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] api_rate_limit                 = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] auth_strategy                  = keystone {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] az_cache_duration              = 3600 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_availability_zone      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_host                   = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_name                   = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_stats_polling_interval = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backup_api_class               = cinder.backup.api.API {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82656]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backup_name_template           = backup-%s {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backup_use_same_host           = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backup_use_temp_snapshot       = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] chap_password                  = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] chap_username                  =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_internal_tenant_project_id = b48234c0f95a48ee9a60d11fda09b353 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_internal_tenant_user_id = 365a9b478a32494b8cc6eb454701b519 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cloned_volume_same_az          = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cluster                        = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] compression_format             = gzip {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] compute_api_class              = cinder.compute.nova.API {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] config_dir                     = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] config_source                  = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] control_exchange               = openstack {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] debug                          = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] default_availability_zone      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] default_group_type             = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] default_volume_type            = lvmdriver-1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] disk_geometry                  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] driver_client_cert             = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] driver_client_cert_key         = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] driver_data_namespace          = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] driver_ssl_cert_path           = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] driver_ssl_cert_verify         = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] driver_use_ssl                 = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] enable_force_upload            = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] enable_new_services            = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] enable_unsupported_driver      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] enforce_multipath_for_image_xfer = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] filter_function                = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_api_insecure            = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_api_servers             = ['http://192.168.122.166/image'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_api_ssl_compression     = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_ca_certificates_file    = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_catalog_info            = image:glance:publicURL {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_certfile                = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_keyfile                 = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_num_retries             = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance_request_timeout         = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] goodness_function              = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] graceful_shutdown_timeout      = 5 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] group_api_class                = cinder.group.api.API {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] host                           = devstack {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_compress_on_upload       = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_conversion_address_space_limit = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_conversion_cpu_limit     = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_conversion_disable       = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_upload_use_cinder_backend = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_upload_use_internal_tenant = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_volume_cache_enabled     = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_volume_cache_max_count   = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] image_volume_cache_max_size_gb = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] init_host_max_objects_retrieval = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] instance_format                = [instance: %(uuid)s]  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] iscsi_target_flags             =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] iscsi_write_cache              = on {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] iser_helper                    = tgtadm {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] iser_ip_address                = 192.168.122.166 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] iser_port                      = 3260 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_color                      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_config_append              = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_dir                        = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_file                       = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_options                    = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_rotate_interval            = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_rotate_interval_type       = days {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] log_rotation_type              = none {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] max_age                        = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] max_logfile_count              = 30 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] max_logfile_size_mb            = 200 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] max_over_subscription_ratio    = 20.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] message_reap_interval          = 86400 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] message_ttl                    = 2592000 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] migration_create_volume_timeout_secs = 300 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack sudo[82661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] monkey_patch                   = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] monkey_patch_modules           = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] my_ip                          = 192.168.122.166 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] no_snapshot_gb_quota           = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] num_iser_scan_tries            = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] num_shell_tries                = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] num_volume_device_scan_tries   = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack sudo[82661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] nvmeof_conn_info_version       = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] nvmet_ns_id                    = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] nvmet_port_id                  = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] osapi_max_limit                = 1000 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] osapi_volume_ext_list          = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] osapi_volume_listen_port       = 8776 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] osapi_volume_use_ssl           = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] osapi_volume_workers           = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] per_volume_size_limit          = -1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] periodic_fuzzy_delay           = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] periodic_interval              = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] public_endpoint                = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] publish_errors                 = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] quota_backup_gigabytes         = 1000 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] quota_backups                  = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] quota_gigabytes                = 1000 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] quota_groups                   = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] quota_snapshots                = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] quota_volumes                  = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] rate_limit_burst               = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] rate_limit_except_level        = CRITICAL {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] rate_limit_interval            = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] reinit_driver_count            = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] replication_device             = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] report_discard_supported       = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] report_interval                = 120 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] reservation_clean_interval     = 86400 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] reservation_expire             = 86400 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] reserved_image_namespaces      = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] reserved_percentage            = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] rpc_response_timeout           = 120 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] run_external_periodic_tasks    = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] scst_target_driver             = iscsi {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] scst_target_iqn_name           = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_down_time              = 720 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] shell_completion               = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] snapshot_name_template         = snapshot-%s {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] snapshot_same_host             = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] split_loggers                  = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] state_path                     = /opt/stack/data/cinder {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] storage_availability_zone      = nova {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] storage_protocol               = iSCSI {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] syslog_log_facility            = LOG_USER {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] target_helper                  = lioadm {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] target_ip_address              = 192.168.122.166 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] target_port                    = 3260 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] target_protocol                = iscsi {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] target_secondary_ip_addresses  = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] trace_flags                    = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] transport_url                  = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] until_refresh                  = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] use_chap_auth                  = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] use_default_quota_class        = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] use_journal                    = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] use_json                       = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] use_multipath_for_image_xfer   = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] use_stderr                     = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] use_syslog                     = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] verify_glance_signatures       = enabled {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_api_class               = cinder.volume.api.API {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_backend_name            = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_clear                   = zero {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_clear_ionice            = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_clear_size              = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_copy_bps_limit          = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_dd_blocksize            = 1M {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_name_template           = volume-%s {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_service_inithost_offload = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volume_usage_audit_period      = month {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] zoning_mode                    = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_concurrency.disable_process_locking = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.auth_section = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.auth_type   = password {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.auth_version = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.cache       = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.certfile    = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.delay_auth_decision = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.http_connect_timeout = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.include_service_catalog = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.insecure    = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.interface   = public {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.keyfile     = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_password =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcache_username =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.region_name = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.service_token_roles_required = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.service_type = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.token_cache_time = 300 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.166/identity {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.backend                  = dogpile.cache.null {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.backend_argument         = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.backend_expiration_time  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.config_prefix            = cache.oslo {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.debug_cache_backend      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.enable_retry_client      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.enable_socket_keepalive  = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.enabled                  = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.expiration_time          = 600 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.hashclient_retry_attempts = 2 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.memcache_dead_retry      = 300 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.memcache_pool_maxsize    = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.memcache_sasl_enabled    = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.password                 = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.proxies                  = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.redis_db                 = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.redis_sentinel_service_name = mymaster {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.redis_server             = localhost:6379 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.retry_attempts           = 2 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.retry_delay              = 0.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.socket_keepalive_count   = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.socket_keepalive_idle    = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.socket_keepalive_interval = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.socket_timeout           = 1.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.tls_allowed_ciphers      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.tls_cafile               = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.tls_certfile             = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.tls_enabled              = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.tls_keyfile              = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cache.username                 = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] coordination.backend_url       = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.asyncio_connection    = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.asyncio_slave_connection = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.backend               = sqlalchemy {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.connection            = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.connection_debug      = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.connection_parameters =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.connection_recycle_time = 3600 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.connection_trace      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.db_inc_retry_interval = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.db_max_retries        = 20 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.db_max_retry_interval = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.db_retry_interval     = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.max_overflow          = 50 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.max_pool_size         = 5 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.max_retries           = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.mysql_wsrep_sync_wait = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.pool_timeout          = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.retry_interval        = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.slave_connection      = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.sqlite_synchronous    = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.synchronous_reader    = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] database.use_db_reconnect      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.connection_string     = messaging:// {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.enabled               = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.es_doc_type           = notification {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.es_scroll_size        = 10000 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.es_scroll_time        = 2m {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.filter_error_trace    = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.hmac_keys             = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.sentinel_service_name = mymaster {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.socket_timeout        = 0.1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.trace_requests        = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler.trace_sqlalchemy      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler_jaeger.process_tags   = {} {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler_jaeger.service_name_prefix = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] profiler_otlp.service_name_prefix = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.enforce_new_defaults = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: WARNING oslo_config.cfg [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.enforce_scope      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.policy_default_rule = default {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.policy_file        = policy.yaml {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] privsep_osbrick.group          = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] privsep_osbrick.helper_command = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] privsep_osbrick.user           = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_sys_admin.group         = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_sys_admin.helper_command = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] cinder_sys_admin.user          = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.auth_section      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.auth_type         = password {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.cafile            = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.certfile          = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.collect_timing    = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.insecure          = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.keyfile           = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.send_service_user_token = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.split_loggers     = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] service_user.timeout           = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.auth_section            = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.auth_type               = password {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.certfile                = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.collect_timing          = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.insecure                = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.keyfile                 = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.region_name             = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.split_loggers           = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] glance.timeout                 = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.backend_availability_zone = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.chap_password = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.chap_username =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.disk_geometry = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.driver_client_cert = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.driver_client_cert_key = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.driver_data_namespace = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.driver_use_ssl = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.enable_unsupported_driver = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.extra_capabilities = {} {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.filter_function = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.goodness_function = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.iscsi_target_flags =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.iscsi_write_cache = on {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.iser_helper   = tgtadm {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.iser_ip_address = 192.168.122.166 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.iser_port     = 3260 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.lvm_share_target = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.lvm_type      = auto {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.num_shell_tries = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.nvmet_port_id = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.replication_device = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.report_discard_supported = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.reserved_percentage = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.scst_target_driver = iscsi {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.scst_target_iqn_name = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.storage_protocol = iSCSI {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.target_helper = tgtadm {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.target_ip_address = 192.168.122.166 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.target_port   = 3260 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.target_protocol = iscsi {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.trace_flags   = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.unique_fqdn_network = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.use_chap_auth = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_backend_name = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_clear  = zero {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_clear_ionice = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_clear_size = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_reports.file_event_handler = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_reports.log_dir           = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.backend_availability_zone = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.backend_host       = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.chap_password      = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.chap_username      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.disk_geometry      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.driver_client_cert = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.driver_data_namespace = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.extra_capabilities = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.filter_function    = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.goodness_function  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.iser_helper        = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.iser_ip_address    = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.iser_port          = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.iser_target_prefix = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.lvm_share_target   = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.lvm_type           = auto {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.num_shell_tries    = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.replication_device = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.report_discard_supported = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.reserved_percentage = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.scst_target_driver = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.storage_protocol   = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.target_helper      = lioadm {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.target_ip_address  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.target_port        = 3260 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.trace_flags        = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.use_chap_auth      = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_clear       = zero {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_clear_size  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] lvmdriver-1.volumes_dir        = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.ssl      = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_notifications.driver = [] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_notifications.retry = -1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] key_manager.fixed_key          = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.barbican_api_version  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.barbican_endpoint     = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.barbican_endpoint_type = public {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.barbican_region_name  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.cafile                = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.certfile              = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.collect_timing        = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.insecure              = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.keyfile               = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.number_of_retries     = 60 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.retry_delay           = 1 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.send_service_user_token = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.split_loggers         = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.timeout               = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.verify_ssl            = True {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican.verify_ssl_path       = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.auth_section = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.auth_type = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.cafile   = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.certfile = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.collect_timing = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.insecure = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.keyfile  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.split_loggers = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] barbican_service_user.timeout  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.approle_role_id          = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.approle_secret_id        = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.kv_mountpoint            = secret {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.kv_path                  = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.kv_version               = 2 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.namespace                = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.root_token_id            = **** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.ssl_ca_crt_file          = None {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.timeout                  = 60.0 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.use_ssl                  = False {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:06:27 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] ******************************************************************************** {{(pid=82483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 24 04:06:28 devstack sudo[82661]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.786s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:28 devstack sudo[82684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:28 devstack sudo[82684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:28 devstack sudo[82684]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.656s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:06:28 devstack cinder-volume[82656]: INFO cinder.brick.local_dev.lvm [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 24 04:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:28 devstack sudo[82937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:28 devstack sudo[82937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:29 devstack sudo[82937]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:29 devstack cinder-volume[82656]: DEBUG cinder.brick.local_dev.lvm [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82656) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 24 04:06:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:29 devstack sudo[83147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:29 devstack sudo[83147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:31 devstack sudo[83147]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.490s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:31 devstack sudo[83403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:31 devstack sudo[83403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:31 devstack sudo[83403]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:31 devstack sudo[83442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 24 04:06:31 devstack sudo[83442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:32 devstack sudo[83442]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.694s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:32 devstack sudo[83446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:32 devstack sudo[83446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:33 devstack sudo[83446]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:33 devstack sudo[83456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:33 devstack sudo[83456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:33 devstack sudo[83456]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.809s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:34 devstack sudo[83462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:34 devstack sudo[83462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:34 devstack sudo[83462]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:34 devstack sudo[83467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:34 devstack sudo[83467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:35 devstack sudo[83467]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.993s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:35 devstack sudo[83478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:35 devstack sudo[83478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:36 devstack sudo[83478]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.809s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:36 devstack cinder-volume[82656]: INFO cinder.volume.drivers.lvm [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 24 04:06:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:36 devstack sudo[83491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:36 devstack sudo[83491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:37 devstack cinder-volume[82483]: DEBUG dbcounter [-] [82483] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:06:37 devstack sudo[83491]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.lvm [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Updating volume stats {{(pid=82656) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:06:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:37 devstack sudo[83604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:37 devstack sudo[83604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:37 devstack sudo[83604]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:37 devstack sudo[83745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:37 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:38 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:38 devstack sudo[83748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:38 devstack sudo[83748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:39 devstack sudo[83748]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.672s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:39 devstack sudo[83751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:39 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:39 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:39 devstack cinder-volume[82656]: INFO cinder.volume.driver [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Driver hasn't implemented _init_vendor_properties()
Jun 24 04:06:39 devstack cinder-volume[82656]: DEBUG cinder.volume.driver [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82656) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 24 04:06:39 devstack cinder-volume[82656]: DEBUG oslo_db.sqlalchemy.engines [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:06:39 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writer thread running {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:06:40 devstack cinder-volume[82656]: DEBUG cinder.db.api [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Building query based on filter {{(pid=82656) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 24 04:06:40 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82656) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 24 04:06:40 devstack cinder-volume[82656]: INFO cinder.keymgr.migration [None req-e7f089d2-561a-4536-817f-9914f07272dd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 24 04:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.lvm [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Updating volume stats {{(pid=82656) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:40 devstack sudo[83759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:40 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:40 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:40 devstack sudo[83762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:40 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:41 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:41 devstack sudo[83766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:41 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:42 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:42 devstack sudo[83770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:42 devstack sudo[83770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:42 devstack sudo[83770]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:42 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:06:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Driver initialization completed successfully.
Jun 24 04:06:42 devstack cinder-volume[82656]: INFO cinder.manager [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Initiating service 2 cleanup
Jun 24 04:06:42 devstack cinder-volume[82656]: INFO cinder.manager [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Service 2 cleanup completed.
Jun 24 04:06:42 devstack cinder-volume[82656]: DEBUG cinder.service [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Creating RPC server for service cinder-volume {{(pid=82656) start /opt/stack/cinder/cinder/service.py:231}}
Jun 24 04:06:42 devstack cinder-volume[82656]: DEBUG cinder.service [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82656) start /opt/stack/cinder/cinder/service.py:237}}
Jun 24 04:06:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 24 04:06:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.lvm [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Updating volume stats {{(pid=82656) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:06:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:42 devstack sudo[83774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:42 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:43 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:43 devstack sudo[83780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:43 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:44 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:44 devstack sudo[83837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:44 devstack sudo[83837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:44 devstack sudo[83837]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:44 devstack sudo[83840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:44 devstack sudo[83840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:45 devstack sudo[83840]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-08d9b3fd-3104-4aec-a512-bebb53c9f041 None None] Driver post RPC initialization completed successfully.
Jun 24 04:06:55 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=4 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:06:55 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:07:11 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running periodic task VolumeManager._thread_info {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:07:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] thread count: 6 {{(pid=82656) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:07:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] thread info: [<_MainThread(MainThread, started 128106105245824)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128105993876416)>, <Thread(Thread-3 (stat_writer), started daemon 128105992568000)>, <Thread(Rabbit-heartbeat, started daemon 128105993338112)>, <Thread(Thread-5 (_runner), started daemon 128105991405696)>, <Thread(Thread-7 (_runner), started daemon 128105991520832)>] {{(pid=82656) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:08:11 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:08:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.lvm [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Updating volume stats {{(pid=82656) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:08:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:08:11 devstack sudo[86204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:08:11 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:08:12 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root
Jun 24 04:08:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:08:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:08:12 devstack sudo[86207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:08:12 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:08:12 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root
Jun 24 04:08:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:08:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:08:12 devstack sudo[86213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:08:12 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:08:13 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root
Jun 24 04:08:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:08:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:08:13 devstack sudo[86605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:08:13 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:08:14 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root
Jun 24 04:08:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:08:14 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:08:14 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running periodic task VolumeManager._thread_info {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:08:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] thread count: 6 {{(pid=82656) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:08:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] thread info: [<_MainThread(MainThread, started 128106105245824)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128105993876416)>, <Thread(Thread-3 (stat_writer), started daemon 128105992568000)>, <Thread(Rabbit-heartbeat, started daemon 128105993338112)>, <Thread(Thread-5 (_runner), started daemon 128105991405696)>, <Thread(Thread-7 (_runner), started daemon 128105991520832)>] {{(pid=82656) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:08:55 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=1 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:08:55 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=1 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:09:11 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:09:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.lvm [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Updating volume stats {{(pid=82656) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:09:11 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:09:11 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:09:12 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Jun 24 04:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:09:12 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:09:12 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:09:12 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Jun 24 04:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:09:12 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:09:12 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:09:13 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Jun 24 04:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:09:13 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:09:13 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:09:14 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Jun 24 04:09:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:09:14 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:09:14 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running periodic task VolumeManager._thread_info {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:09:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] thread count: 6 {{(pid=82656) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:09:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] thread info: [<_MainThread(MainThread, started 128106105245824)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128105993876416)>, <Thread(Thread-3 (stat_writer), started daemon 128105992568000)>, <Thread(Rabbit-heartbeat, started daemon 128105993338112)>, <Thread(Thread-5 (_runner), started daemon 128105991405696)>, <Thread(Thread-7 (_runner), started daemon 128105991520832)>] {{(pid=82656) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:10:11 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:10:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.lvm [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Updating volume stats {{(pid=82656) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:10:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:11 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:10:11 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:12 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:12 devstack sudo[91090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:10:12 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:12 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:12 devstack sudo[91094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:10:12 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:13 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:13 devstack sudo[91108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:10:13 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:14 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:14 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:10:14 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running periodic task VolumeManager._thread_info {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:10:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] thread count: 6 {{(pid=82656) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:10:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] thread info: [<_MainThread(MainThread, started 128106105245824)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128105993876416)>, <Thread(Thread-3 (stat_writer), started daemon 128105992568000)>, <Thread(Rabbit-heartbeat, started daemon 128105993338112)>, <Thread(Thread-5 (_runner), started daemon 128105991405696)>, <Thread(Thread-7 (_runner), started daemon 128105991520832)>] {{(pid=82656) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:10:55 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:11:11 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:11:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.lvm [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Updating volume stats {{(pid=82656) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:11:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:11 devstack sudo[92210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:11:11 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:12 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:12 devstack sudo[92245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:11:12 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:12 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:12 devstack sudo[92250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:11:12 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:13 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:13 devstack sudo[92254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:11:13 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:14 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:14 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-bcb8f402-b182-48c7-8603-098525cb90f7 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:11:30 devstack cinder-volume[82483]: INFO oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Caught SIGTERM, stopping children
Jun 24 04:11:30 devstack cinder-volume[82483]: DEBUG oslo_concurrency.lockutils [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Acquiring lock "singleton_lock" {{(pid=82483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:30 devstack cinder-volume[82483]: DEBUG oslo_concurrency.lockutils [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Acquired lock "singleton_lock" {{(pid=82483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:30 devstack cinder-volume[82483]: DEBUG oslo_concurrency.lockutils [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Releasing lock "singleton_lock" {{(pid=82483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:30 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Stop services. {{(pid=82483) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 24 04:11:30 devstack cinder-volume[82483]: DEBUG oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Killing children. {{(pid=82483) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 24 04:11:30 devstack cinder-volume[82483]: INFO oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Waiting on 1 children to exit
Jun 24 04:11:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Acquiring lock "singleton_lock" {{(pid=82656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Acquired lock "singleton_lock" {{(pid=82656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Releasing lock "singleton_lock" {{(pid=82656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:32 devstack cinder-volume[82656]: WARNING amqp [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 24 04:11:32 devstack cinder-volume[82656]: WARNING amqp [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 24 04:11:32 devstack cinder-volume[82483]: INFO oslo_service.backend._eventlet.service [None req-286ed943-8d30-4383-88e4-26ffba96ab6e None None] Child 82656 exited with status 0
Jun 24 04:11:33 devstack cinder-volume[92751]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 24 04:11:33 devstack cinder-volume[92751]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:11:33 devstack cinder-volume[92751]: we strongly recommend against using it for new projects.
Jun 24 04:11:33 devstack cinder-volume[92751]: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:11:33 devstack cinder-volume[92751]: framework.  For more detail see
Jun 24 04:11:33 devstack cinder-volume[92751]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:11:33 devstack cinder-volume[92751]:   import eventlet  # noqa
Jun 24 04:11:35 devstack cinder-volume[92751]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:35 devstack cinder-volume[92751]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:35 devstack cinder-volume[92751]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:35 devstack cinder-volume[92751]: INFO dbcounter [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Registered counter for database cinder
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_db.sqlalchemy.engines [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG dbcounter [-] [92751] Writer thread running {{(pid=92751) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:11:36 devstack cinder-volume[92751]: INFO cinder.rpc [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 24 04:11:36 devstack cinder-volume[92751]: INFO cinder.rpc [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_db.sqlalchemy.engines [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:36 devstack cinder-volume[92751]: INFO cinder.volume.manager [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Determined volume DB was empty at startup.
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG cinder.volume.manager [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92751) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 24 04:11:36 devstack cinder-volume[92751]: INFO cinder.volume.manager [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 24 04:11:36 devstack cinder-volume[92751]: WARNING stevedore.named [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 24 04:11:36 devstack cinder-volume[92751]: WARNING castellan.key_manager [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:11:36 devstack cinder-volume[92751]: WARNING cinder.keymgr.conf_key_mgr [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:11:36 devstack cinder-volume[92751]: INFO cinder.volume.manager [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_db.sqlalchemy.engines [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92751) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:36 devstack cinder-volume[92751]: INFO oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Starting 1 workers
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Started child 92969 {{(pid=92751) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Full set of CONF: {{(pid=92751) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] ******************************************************************************** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Configuration options gathered from: {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] ================================================================================ {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] allow_availability_zone_fallback = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] allow_compression_on_image_upload = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] allowed_direct_url_schemes     = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] api_rate_limit                 = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] auth_strategy                  = keystone {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_availability_zone      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_host                   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_name                   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_stats_polling_interval = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backup_api_class               = cinder.backup.api.API {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backup_name_template           = backup-%s {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backup_use_same_host           = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backup_use_temp_snapshot       = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92969]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] chap_password                  = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] chap_username                  =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_internal_tenant_project_id = b48234c0f95a48ee9a60d11fda09b353 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_internal_tenant_user_id = 365a9b478a32494b8cc6eb454701b519 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cluster                        = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] compression_format             = gzip {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] compute_api_class              = cinder.compute.nova.API {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] config_dir                     = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] config_source                  = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] control_exchange               = openstack {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] debug                          = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] default_availability_zone      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] default_group_type             = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] default_volume_type            = QuobyteHD {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] disk_geometry                  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] driver_client_cert             = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] driver_client_cert_key         = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] driver_data_namespace          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] driver_ssl_cert_path           = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] driver_ssl_cert_verify         = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] driver_use_ssl                 = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] enable_new_services            = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] enable_unsupported_driver      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] enabled_backends               = ['QuobyteHD'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] enforce_multipath_for_image_xfer = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] filter_function                = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_api_insecure            = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_api_servers             = ['http://192.168.122.166/image'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_api_ssl_compression     = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_ca_certificates_file    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_catalog_info            = image:glance:publicURL {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_certfile                = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_keyfile                 = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_num_retries             = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance_request_timeout         = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] goodness_function              = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] graceful_shutdown_timeout      = 5 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] group_api_class                = cinder.group.api.API {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] host                           = devstack {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_compress_on_upload       = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_conversion_address_space_limit = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_conversion_cpu_limit     = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_conversion_disable       = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_upload_use_cinder_backend = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_upload_use_internal_tenant = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_volume_cache_enabled     = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_volume_cache_max_count   = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] image_volume_cache_max_size_gb = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] init_host_max_objects_retrieval = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] instance_format                = [instance: %(uuid)s]  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] iscsi_target_flags             =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] iscsi_write_cache              = on {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] iser_helper                    = tgtadm {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] iser_ip_address                = 192.168.122.166 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] iser_port                      = 3260 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_color                      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_config_append              = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_dir                        = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_file                       = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_options                    = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_rotate_interval            = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_rotate_interval_type       = days {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] log_rotation_type              = none {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] max_age                        = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] max_logfile_count              = 30 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] max_logfile_size_mb            = 200 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] max_over_subscription_ratio    = 20.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] message_reap_interval          = 86400 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] message_ttl                    = 2592000 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] migration_create_volume_timeout_secs = 300 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] monkey_patch                   = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] monkey_patch_modules           = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] my_ip                          = 192.168.122.166 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] no_snapshot_gb_quota           = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] num_iser_scan_tries            = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] num_shell_tries                = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] num_volume_device_scan_tries   = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] nvmeof_conn_info_version       = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] nvmet_ns_id                    = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] nvmet_port_id                  = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] osapi_max_limit                = 1000 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] osapi_volume_ext_list          = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] osapi_volume_listen_port       = 8776 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] osapi_volume_use_ssl           = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] osapi_volume_workers           = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] per_volume_size_limit          = -1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] periodic_fuzzy_delay           = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] periodic_interval              = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] public_endpoint                = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] publish_errors                 = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] quota_backup_gigabytes         = 1000 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] quota_backups                  = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] quota_gigabytes                = 1000 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] quota_groups                   = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] quota_snapshots                = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] quota_volumes                  = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] rate_limit_burst               = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] rate_limit_except_level        = CRITICAL {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] rate_limit_interval            = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] reinit_driver_count            = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] replication_device             = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] report_discard_supported       = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] report_interval                = 120 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] reservation_clean_interval     = 86400 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] reservation_expire             = 86400 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] reserved_image_namespaces      = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] reserved_percentage            = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] rpc_response_timeout           = 120 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] run_external_periodic_tasks    = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] scst_target_driver             = iscsi {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] scst_target_iqn_name           = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_down_time              = 720 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] shell_completion               = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] snapshot_name_template         = snapshot-%s {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] split_loggers                  = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] state_path                     = /opt/stack/data/cinder {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] storage_availability_zone      = nova {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] storage_protocol               = iSCSI {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] syslog_log_facility            = LOG_USER {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] target_helper                  = lioadm {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] target_ip_address              = 192.168.122.166 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] target_port                    = 3260 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] target_protocol                = iscsi {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] target_secondary_ip_addresses  = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] trace_flags                    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] transport_url                  = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] until_refresh                  = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] use_chap_auth                  = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] use_default_quota_class        = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] use_journal                    = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] use_json                       = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] use_multipath_for_image_xfer   = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] use_stderr                     = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] use_syslog                     = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] verify_glance_signatures       = enabled {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_api_class               = cinder.volume.api.API {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_backend_name            = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_clear                   = zero {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_clear_ionice            = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_clear_size              = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_copy_bps_limit          = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_dd_blocksize            = 1M {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_name_template           = volume-%s {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_service_inithost_offload = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volume_usage_audit_period      = month {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] zoning_mode                    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_concurrency.disable_process_locking = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92969]: INFO cinder.volume.manager [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92969]: DEBUG cinder.volume.drivers.remotefs [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92969) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.auth_section = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.auth_type   = password {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.auth_version = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.cache       = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.certfile    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.include_service_catalog = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.insecure    = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.interface   = public {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.keyfile     = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_password =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcache_username =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.region_name = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.service_type = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.166/identity {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.backend                  = dogpile.cache.null {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.backend_argument         = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.backend_expiration_time  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.config_prefix            = cache.oslo {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.debug_cache_backend      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.enable_retry_client      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.enable_socket_keepalive  = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.enabled                  = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.expiration_time          = 600 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.hashclient_retry_attempts = 2 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.memcache_dead_retry      = 300 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.memcache_pool_maxsize    = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.memcache_sasl_enabled    = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.password                 = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.proxies                  = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.redis_db                 = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.redis_server             = localhost:6379 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.retry_attempts           = 2 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.retry_delay              = 0.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.socket_keepalive_count   = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.socket_keepalive_idle    = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.socket_keepalive_interval = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.socket_timeout           = 1.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.tls_allowed_ciphers      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.tls_cafile               = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.tls_certfile             = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.tls_enabled              = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.tls_keyfile              = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cache.username                 = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] coordination.backend_url       = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.asyncio_connection    = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.asyncio_slave_connection = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.backend               = sqlalchemy {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.connection            = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.connection_debug      = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.connection_parameters =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.connection_recycle_time = 3600 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.connection_trace      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.db_inc_retry_interval = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.db_max_retries        = 20 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.db_max_retry_interval = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.db_retry_interval     = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.max_overflow          = 50 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.max_pool_size         = 5 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.max_retries           = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.mysql_wsrep_sync_wait = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.pool_timeout          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.retry_interval        = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.slave_connection      = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.sqlite_synchronous    = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.synchronous_reader    = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] database.use_db_reconnect      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.connection_string     = messaging:// {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.enabled               = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.es_doc_type           = notification {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.es_scroll_size        = 10000 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.es_scroll_time        = 2m {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.filter_error_trace    = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.hmac_keys             = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.sentinel_service_name = mymaster {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.socket_timeout        = 0.1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.trace_requests        = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler.trace_sqlalchemy      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler_jaeger.process_tags   = {} {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler_jaeger.service_name_prefix = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] profiler_otlp.service_name_prefix = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.enforce_new_defaults = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: WARNING oslo_config.cfg [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.enforce_scope      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.policy_default_rule = default {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.policy_file        = policy.yaml {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] privsep_osbrick.group          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] privsep_osbrick.helper_command = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] privsep_osbrick.user           = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_sys_admin.group         = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_sys_admin.helper_command = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] cinder_sys_admin.user          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.auth_section      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.auth_type         = password {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.cafile            = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.certfile          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.collect_timing    = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.insecure          = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.keyfile           = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.send_service_user_token = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.split_loggers     = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] service_user.timeout           = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.auth_section            = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.auth_type               = password {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.certfile                = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.collect_timing          = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.insecure                = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.keyfile                 = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.region_name             = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.split_loggers           = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] glance.timeout                 = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.backend_availability_zone = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.chap_password = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.chap_username =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.disk_geometry = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.driver_client_cert = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.driver_client_cert_key = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.driver_data_namespace = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.driver_use_ssl = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.extra_capabilities = {} {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.filter_function = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.goodness_function = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.iscsi_target_flags =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.iscsi_write_cache = on {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.iser_helper   = tgtadm {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.iser_ip_address = 192.168.122.166 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.iser_port     = 3260 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_host      =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_login     = admin {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_mount_options = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_password  = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_private_key =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_share_path =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.num_shell_tries = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.quobyte_volume_url = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.replication_device = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.report_discard_supported = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.reserved_percentage = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.target_helper = tgtadm {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.target_ip_address = 192.168.122.166 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.target_port   = 3260 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.target_protocol = iscsi {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.trace_flags   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.unique_fqdn_network = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.use_chap_auth = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volume_backend_name = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volume_clear  = zero {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volume_clear_ionice = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volume_clear_size = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_reports.file_event_handler = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_reports.log_dir           = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.backend_availability_zone = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.backend_host         = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.chap_password        = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.chap_username        = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.chiscsi_conf         = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.disk_geometry        = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.driver_client_cert   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.driver_data_namespace = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.driver_use_ssl       = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.extra_capabilities   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.filter_function      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.goodness_function    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92969]: DEBUG cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92969) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 24 04:11:36 devstack cinder-volume[92969]: WARNING cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 24 04:11:36 devstack cinder-volume[92969]: WARNING cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Running cmd (subprocess): mount.quobyte {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.iser_helper          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.iser_ip_address      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.iser_port            = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.iser_target_prefix   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_host             = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_login            = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_mount_options    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_password         = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_private_key      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_share_path       = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_ssh_port         = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.num_shell_tries      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.nvmet_port_id        = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.replication_device   = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.report_discard_supported = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.reserved_percentage  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.scst_target_driver   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.storage_protocol     = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.target_helper        = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.target_ip_address    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.target_port          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.target_prefix        = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.target_protocol      = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.trace_flags          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.use_chap_auth        = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volume_clear         = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volume_clear_size    = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] QuobyteHD.volumes_dir          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.ssl      = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_notifications.driver = [] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_notifications.retry = -1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] key_manager.fixed_key          = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.barbican_api_version  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.barbican_endpoint     = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.barbican_endpoint_type = public {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.barbican_region_name  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.cafile                = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.certfile              = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.collect_timing        = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.insecure              = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.keyfile               = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.number_of_retries     = 60 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.retry_delay           = 1 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.send_service_user_token = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.split_loggers         = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.timeout               = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.verify_ssl            = True {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:36 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican.verify_ssl_path       = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.auth_section = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.auth_type = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.cafile   = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.certfile = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.collect_timing = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.insecure = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.keyfile  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.split_loggers = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] barbican_service_user.timeout  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.approle_role_id          = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.approle_secret_id        = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.kv_mountpoint            = secret {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.kv_path                  = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.kv_version               = 2 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.namespace                = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.root_token_id            = **** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.ssl_ca_crt_file          = None {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.timeout                  = 60.0 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.use_ssl                  = False {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:37 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] ******************************************************************************** {{(pid=92751) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 24 04:11:37 devstack quobyte-client[92973]: Reading configuration file: /etc/quobyte/client.cfg
Jun 24 04:11:37 devstack quobyte-client[92973]: Invalid parameters found, error: missing mount point.
Jun 24 04:11:37 devstack quobyte-client[92973]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 24 04:11:37 devstack quobyte-client[92973]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=92969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:37 devstack cinder-volume[92969]: INFO cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 ...
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 -c /etc/quobyte/client-cinder.cfg {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:37 devstack sudo[92975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 -c /etc/quobyte/client-cinder.cfg
Jun 24 04:11:37 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:37 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.888s {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:37 devstack cinder-volume[92969]: INFO cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 succeeded
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=92969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.901s {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:37 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:37 devstack sudo[93044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:11:37 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:38 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.787s {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:38 devstack cinder-volume[92969]: INFO cinder.volume.driver [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Driver hasn't implemented _init_vendor_properties()
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG cinder.volume.driver [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92969) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG oslo_db.sqlalchemy.engines [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG dbcounter [-] [92969] Writer thread running {{(pid=92969) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG cinder.db.api [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Building query based on filter {{(pid=92969) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG cinder.image.image_utils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92969) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 24 04:11:38 devstack cinder-volume[92969]: INFO cinder.keymgr.migration [None req-9fb247a8-3956-472c-96b6-eabf1e376947 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=92969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=92969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:38 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:39 devstack sudo[93073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:11:39 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:40 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.071s {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG cinder.manager [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Notifying Schedulers of capabilities ... {{(pid=92969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:11:40 devstack cinder-volume[92969]: INFO cinder.volume.manager [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Driver initialization completed successfully.
Jun 24 04:11:40 devstack cinder-volume[92969]: INFO cinder.manager [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Initiating service 3 cleanup
Jun 24 04:11:40 devstack cinder-volume[92969]: INFO cinder.manager [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Service 3 cleanup completed.
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG cinder.service [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Creating RPC server for service cinder-volume {{(pid=92969) start /opt/stack/cinder/cinder/service.py:231}}
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG cinder.service [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92969) start /opt/stack/cinder/cinder/service.py:237}}
Jun 24 04:11:40 devstack cinder-volume[92969]: INFO cinder.volume.manager [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=92969) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG cinder.volume.drivers.quobyte [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=92969) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92969) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:40 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:40 devstack sudo[93163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:11:40 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:41 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:41 devstack cinder-volume[92969]: DEBUG oslo_concurrency.processutils [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.918s {{(pid=92969) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:41 devstack cinder-volume[92969]: INFO cinder.volume.manager [None req-cae0bb04-e878-40c1-a759-673603d35bd0 None None] Driver post RPC initialization completed successfully.
Jun 24 04:11:42 devstack cinder-volume[92751]: INFO oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Caught SIGTERM, stopping children
Jun 24 04:11:42 devstack cinder-volume[92751]: DEBUG oslo_concurrency.lockutils [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Acquiring lock "singleton_lock" {{(pid=92751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:42 devstack cinder-volume[92751]: DEBUG oslo_concurrency.lockutils [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Acquired lock "singleton_lock" {{(pid=92751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:42 devstack cinder-volume[92751]: DEBUG oslo_concurrency.lockutils [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Releasing lock "singleton_lock" {{(pid=92751) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:42 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Stop services. {{(pid=92751) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 24 04:11:42 devstack cinder-volume[92751]: DEBUG oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Killing children. {{(pid=92751) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 24 04:11:42 devstack cinder-volume[92751]: INFO oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Waiting on 1 children to exit
Jun 24 04:11:42 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Acquiring lock "singleton_lock" {{(pid=92969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:42 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Acquired lock "singleton_lock" {{(pid=92969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:42 devstack cinder-volume[92969]: DEBUG oslo_concurrency.lockutils [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Releasing lock "singleton_lock" {{(pid=92969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:42 devstack cinder-volume[92969]: WARNING amqp [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 24 04:11:42 devstack cinder-volume[92969]: WARNING amqp [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 24 04:11:42 devstack cinder-volume[92751]: INFO oslo_service.backend._eventlet.service [None req-570e0356-b81e-4169-a0c2-14440c5ce523 None None] Child 92969 exited with status 0
Jun 24 04:11:42 devstack cinder-volume[93239]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 24 04:11:42 devstack cinder-volume[93239]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:11:42 devstack cinder-volume[93239]: we strongly recommend against using it for new projects.
Jun 24 04:11:42 devstack cinder-volume[93239]: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:11:42 devstack cinder-volume[93239]: framework.  For more detail see
Jun 24 04:11:42 devstack cinder-volume[93239]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:11:42 devstack cinder-volume[93239]:   import eventlet  # noqa
Jun 24 04:11:45 devstack cinder-volume[93239]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:45 devstack cinder-volume[93239]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:45 devstack cinder-volume[93239]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:46 devstack cinder-volume[93239]: INFO dbcounter [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Registered counter for database cinder
Jun 24 04:11:46 devstack cinder-volume[93239]: DEBUG oslo_db.sqlalchemy.engines [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:46 devstack cinder-volume[93239]: DEBUG dbcounter [-] [93239] Writer thread running {{(pid=93239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:11:46 devstack cinder-volume[93239]: INFO cinder.rpc [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 24 04:11:46 devstack cinder-volume[93239]: INFO cinder.rpc [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 24 04:11:46 devstack cinder-volume[93239]: DEBUG oslo_db.sqlalchemy.engines [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:47 devstack cinder-volume[93239]: INFO cinder.volume.manager [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Determined volume DB was empty at startup.
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG cinder.volume.manager [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93239) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 24 04:11:47 devstack cinder-volume[93239]: WARNING stevedore.named [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 24 04:11:47 devstack cinder-volume[93239]: WARNING castellan.key_manager [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:11:47 devstack cinder-volume[93239]: WARNING cinder.keymgr.conf_key_mgr [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:11:47 devstack cinder-volume[93239]: INFO cinder.volume.manager [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_db.sqlalchemy.engines [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:47 devstack cinder-volume[93239]: INFO oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Starting 1 workers
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Started child 93470 {{(pid=93239) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Full set of CONF: {{(pid=93239) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] ******************************************************************************** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Configuration options gathered from: {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] ================================================================================ {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] allow_availability_zone_fallback = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] allow_compression_on_image_upload = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] allowed_direct_url_schemes     = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] api_rate_limit                 = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] auth_strategy                  = keystone {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_availability_zone      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_host                   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_name                   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_stats_polling_interval = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backup_api_class               = cinder.backup.api.API {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93470]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backup_name_template           = backup-%s {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backup_use_same_host           = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backup_use_temp_snapshot       = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] chap_password                  = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] chap_username                  =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_internal_tenant_project_id = b48234c0f95a48ee9a60d11fda09b353 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_internal_tenant_user_id = 365a9b478a32494b8cc6eb454701b519 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cluster                        = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] compression_format             = gzip {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] compute_api_class              = cinder.compute.nova.API {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] config_dir                     = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] config_source                  = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] control_exchange               = openstack {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] debug                          = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] default_availability_zone      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] default_group_type             = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] default_volume_type            = QuobyteHD {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] disk_geometry                  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] driver_client_cert             = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] driver_client_cert_key         = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] driver_data_namespace          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] driver_ssl_cert_path           = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] driver_ssl_cert_verify         = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] driver_use_ssl                 = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] enable_new_services            = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] enable_unsupported_driver      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] enabled_backends               = ['QuobyteHD'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] enforce_multipath_for_image_xfer = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] filter_function                = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_api_insecure            = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_api_servers             = ['http://192.168.122.166/image'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_api_ssl_compression     = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_ca_certificates_file    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_catalog_info            = image:glance:publicURL {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_certfile                = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_keyfile                 = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_num_retries             = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance_request_timeout         = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] goodness_function              = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] graceful_shutdown_timeout      = 5 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] group_api_class                = cinder.group.api.API {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] host                           = devstack {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_compress_on_upload       = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_conversion_address_space_limit = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_conversion_cpu_limit     = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_conversion_disable       = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_upload_use_cinder_backend = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_upload_use_internal_tenant = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_volume_cache_enabled     = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_volume_cache_max_count   = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] image_volume_cache_max_size_gb = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] init_host_max_objects_retrieval = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] instance_format                = [instance: %(uuid)s]  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] iscsi_target_flags             =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] iscsi_write_cache              = on {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] iser_helper                    = tgtadm {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] iser_ip_address                = 192.168.122.166 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] iser_port                      = 3260 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_color                      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_config_append              = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_dir                        = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_file                       = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_options                    = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_rotate_interval            = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_rotate_interval_type       = days {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] log_rotation_type              = none {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] max_age                        = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] max_logfile_count              = 30 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] max_logfile_size_mb            = 200 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] max_over_subscription_ratio    = 20.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] message_reap_interval          = 86400 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] message_ttl                    = 2592000 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] migration_create_volume_timeout_secs = 300 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] monkey_patch                   = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] monkey_patch_modules           = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] my_ip                          = 192.168.122.166 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] no_snapshot_gb_quota           = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] num_iser_scan_tries            = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93470) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] num_shell_tries                = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] num_volume_device_scan_tries   = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] nvmeof_conn_info_version       = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] nvmet_ns_id                    = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] nvmet_port_id                  = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] osapi_max_limit                = 1000 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] osapi_volume_ext_list          = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] osapi_volume_listen_port       = 8776 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] osapi_volume_use_ssl           = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] osapi_volume_workers           = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] per_volume_size_limit          = -1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] periodic_fuzzy_delay           = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] periodic_interval              = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] public_endpoint                = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] publish_errors                 = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] quota_backup_gigabytes         = 1000 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] quota_backups                  = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] quota_gigabytes                = 1000 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] quota_groups                   = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] quota_snapshots                = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] quota_volumes                  = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] rate_limit_burst               = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] rate_limit_except_level        = CRITICAL {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] rate_limit_interval            = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] reinit_driver_count            = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] replication_device             = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] report_discard_supported       = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] report_interval                = 120 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] reservation_clean_interval     = 86400 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] reservation_expire             = 86400 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] reserved_image_namespaces      = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] reserved_percentage            = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] rpc_response_timeout           = 120 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] run_external_periodic_tasks    = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] scst_target_driver             = iscsi {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] scst_target_iqn_name           = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_down_time              = 720 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] shell_completion               = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] snapshot_name_template         = snapshot-%s {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] split_loggers                  = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] state_path                     = /opt/stack/data/cinder {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] storage_availability_zone      = nova {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] storage_protocol               = iSCSI {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] syslog_log_facility            = LOG_USER {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] target_helper                  = lioadm {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] target_ip_address              = 192.168.122.166 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] target_port                    = 3260 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] target_protocol                = iscsi {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] target_secondary_ip_addresses  = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] trace_flags                    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] transport_url                  = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] until_refresh                  = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] use_chap_auth                  = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] use_default_quota_class        = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] use_journal                    = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] use_json                       = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] use_multipath_for_image_xfer   = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] use_stderr                     = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] use_syslog                     = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] verify_glance_signatures       = enabled {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_api_class               = cinder.volume.api.API {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_backend_name            = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_clear                   = zero {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_clear_ionice            = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_clear_size              = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_copy_bps_limit          = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_dd_blocksize            = 1M {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_name_template           = volume-%s {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_service_inithost_offload = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volume_usage_audit_period      = month {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] zoning_mode                    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_concurrency.disable_process_locking = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.auth_section = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.auth_type   = password {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.auth_version = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.cache       = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.certfile    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.delay_auth_decision = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.http_connect_timeout = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.include_service_catalog = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.insecure    = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.interface   = public {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.keyfile     = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_password =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93470) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 24 04:11:47 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 24 04:11:47 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Running cmd (subprocess): mount.quobyte {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcache_username =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.region_name = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.service_token_roles_required = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.service_type = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.token_cache_time = 300 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.166/identity {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.backend                  = dogpile.cache.null {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.backend_argument         = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.backend_expiration_time  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.config_prefix            = cache.oslo {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.debug_cache_backend      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.enable_retry_client      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.enable_socket_keepalive  = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.enabled                  = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.expiration_time          = 600 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.hashclient_retry_attempts = 2 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.memcache_dead_retry      = 300 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.memcache_pool_maxsize    = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.memcache_sasl_enabled    = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.password                 = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.proxies                  = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.redis_db                 = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.redis_sentinel_service_name = mymaster {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.redis_server             = localhost:6379 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.retry_attempts           = 2 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.retry_delay              = 0.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.socket_keepalive_count   = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.socket_keepalive_idle    = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.socket_keepalive_interval = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.socket_timeout           = 1.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.tls_allowed_ciphers      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.tls_cafile               = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.tls_certfile             = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.tls_enabled              = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.tls_keyfile              = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cache.username                 = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] coordination.backend_url       = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.asyncio_connection    = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.asyncio_slave_connection = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.backend               = sqlalchemy {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.connection            = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.connection_debug      = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.connection_parameters =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.connection_recycle_time = 3600 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.connection_trace      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.db_inc_retry_interval = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.db_max_retries        = 20 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.db_max_retry_interval = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.db_retry_interval     = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.max_overflow          = 50 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.max_pool_size         = 5 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.max_retries           = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.mysql_wsrep_sync_wait = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.pool_timeout          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.retry_interval        = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.slave_connection      = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.sqlite_synchronous    = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.synchronous_reader    = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] database.use_db_reconnect      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.connection_string     = messaging:// {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.enabled               = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.es_doc_type           = notification {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.es_scroll_size        = 10000 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.es_scroll_time        = 2m {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.filter_error_trace    = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.hmac_keys             = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.sentinel_service_name = mymaster {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.socket_timeout        = 0.1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.trace_requests        = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler.trace_sqlalchemy      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler_jaeger.process_tags   = {} {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler_jaeger.service_name_prefix = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] profiler_otlp.service_name_prefix = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.enforce_new_defaults = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: WARNING oslo_config.cfg [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.enforce_scope      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.policy_default_rule = default {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.policy_file        = policy.yaml {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] privsep_osbrick.group          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] privsep_osbrick.helper_command = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] privsep_osbrick.user           = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_sys_admin.group         = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_sys_admin.helper_command = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack sudo[93480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] cinder_sys_admin.user          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.auth_section      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.auth_type         = password {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.cafile            = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.certfile          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.collect_timing    = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.insecure          = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.keyfile           = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.send_service_user_token = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.split_loggers     = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] service_user.timeout           = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.auth_section            = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.auth_type               = password {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.certfile                = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.collect_timing          = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.insecure                = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.keyfile                 = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.region_name             = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.split_loggers           = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] glance.timeout                 = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.backend_availability_zone = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.chap_password = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.chap_username =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.disk_geometry = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.driver_client_cert = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.driver_client_cert_key = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.driver_data_namespace = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.driver_use_ssl = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.enable_unsupported_driver = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.extra_capabilities = {} {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.filter_function = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.goodness_function = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.iscsi_target_flags =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.iscsi_write_cache = on {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.iser_helper   = tgtadm {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.iser_ip_address = 192.168.122.166 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.iser_port     = 3260 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_host      =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_login     = admin {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_mount_options = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_password  = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_private_key =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_share_path =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.num_shell_tries = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.nvmet_port_id = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.quobyte_client_cfg = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.quobyte_volume_url = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.replication_device = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.report_discard_supported = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.reserved_percentage = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.scst_target_driver = iscsi {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.scst_target_iqn_name = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.storage_protocol = iSCSI {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.target_helper = tgtadm {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.target_ip_address = 192.168.122.166 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.target_port   = 3260 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.target_protocol = iscsi {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.trace_flags   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.unique_fqdn_network = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.use_chap_auth = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volume_backend_name = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volume_clear  = zero {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volume_clear_ionice = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volume_clear_size = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_reports.file_event_handler = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_reports.log_dir           = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.backend_availability_zone = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.backend_host         = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.chap_password        = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.chap_username        = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.chiscsi_conf         = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.disk_geometry        = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.driver_client_cert   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.driver_client_cert_key = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.driver_data_namespace = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.driver_use_ssl       = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.extra_capabilities   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.filter_function      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.goodness_function    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.iser_helper          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.iser_ip_address      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.iser_port            = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.iser_target_prefix   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_host             = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_login            = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_mount_options    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_password         = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_private_key      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_share_path       = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_ssh_port         = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.num_shell_tries      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.nvmet_port_id        = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.replication_device   = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.report_discard_supported = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.reserved_percentage  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.scst_target_driver   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.storage_protocol     = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.target_helper        = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.target_ip_address    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.target_port          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.target_prefix        = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.target_protocol      = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.trace_flags          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.use_chap_auth        = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volume_clear         = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volume_clear_size    = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] QuobyteHD.volumes_dir          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.ssl      = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_notifications.driver = [] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_notifications.retry = -1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] oslo_messaging_notifications.transport_url = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] key_manager.fixed_key          = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.barbican_api_version  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.barbican_endpoint     = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.barbican_endpoint_type = public {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.barbican_region_name  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.cafile                = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.certfile              = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.collect_timing        = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.insecure              = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.keyfile               = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.number_of_retries     = 60 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.retry_delay           = 1 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.send_service_user_token = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.split_loggers         = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.timeout               = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.verify_ssl            = True {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican.verify_ssl_path       = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.auth_section = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.auth_type = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.cafile   = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.certfile = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.collect_timing = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.insecure = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.keyfile  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.split_loggers = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] barbican_service_user.timeout  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.approle_role_id          = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.approle_secret_id        = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.kv_mountpoint            = secret {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.kv_path                  = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.kv_version               = 2 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.namespace                = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.root_token_id            = **** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.ssl_ca_crt_file          = None {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.timeout                  = 60.0 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.use_ssl                  = False {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:47 devstack cinder-volume[93239]: DEBUG oslo_service.backend._eventlet.service [None req-54eada32-9793-4681-b41e-7ded801f0d2f None None] ******************************************************************************** {{(pid=93239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 24 04:11:48 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.048s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:48 devstack cinder-volume[93470]: INFO cinder.volume.driver [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Driver hasn't implemented _init_vendor_properties()
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG cinder.volume.driver [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93470) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG oslo_db.sqlalchemy.engines [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writer thread running {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG cinder.db.api [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Building query based on filter {{(pid=93470) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93470) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:48 devstack cinder-volume[93470]: INFO cinder.keymgr.migration [None req-e0e45366-8790-4e05-bcaf-393bc04ddd20 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 24 04:11:48 devstack sudo[93492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:11:48 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:49 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.739s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:11:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Driver initialization completed successfully.
Jun 24 04:11:49 devstack cinder-volume[93470]: INFO cinder.manager [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Initiating service 3 cleanup
Jun 24 04:11:49 devstack cinder-volume[93470]: INFO cinder.manager [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Service 3 cleanup completed.
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG cinder.service [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Creating RPC server for service cinder-volume {{(pid=93470) start /opt/stack/cinder/cinder/service.py:231}}
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG cinder.service [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93470) start /opt/stack/cinder/cinder/service.py:237}}
Jun 24 04:11:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:49 devstack sudo[93514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:11:49 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:50 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.654s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:50 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-cfc66b9f-6565-4345-bc2d-745c6cd27978 None None] Driver post RPC initialization completed successfully.
Jun 24 04:11:57 devstack cinder-volume[93239]: DEBUG dbcounter [-] [93239] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:11:58 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:12:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=4 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:12:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:12:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 6 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:12:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Flow 'volume_create_manager' (51b3dff1-be56-47a2-90ba-b7a7eff3848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8651fd34-58d5-4e57-940b-d4206d9e2878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8651fd34-58d5-4e57-940b-d4206d9e2878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-861332663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbb73c2-9fb9-48f9-b0fc-766b66701b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6fd6bc99544d63817d2460ce9df84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:12:48Z,use_quota=True,user_id='97f6e1001a3c44f495a7cfc709eee666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de50efdb-7297-44d6-9748-fc35f2e93593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de50efdb-7297-44d6-9748-fc35f2e93593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a721408-13ef-4dc4-9cb8-489872f3b45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a721408-13ef-4dc4-9cb8-489872f3b45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bbb73c2-9fb9-48f9-b0fc-766b66701b2c', 'volume_name': 'volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca52f25-d45a-4c05-9626-ad0c76e4cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca52f25-d45a-4c05-9626-ad0c76e4cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c78ffd-17e8-4fdc-98e9-83c12c79feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:48 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Volume 0bbb73c2-9fb9-48f9-b0fc-766b66701b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c', 'volume_size': 1}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-861332663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbb73c2-9fb9-48f9-b0fc-766b66701b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e6fd6bc99544d63817d2460ce9df84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:12:48Z,use_quota=True,user_id='97f6e1001a3c44f495a7cfc709eee666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Creating volume 0bbb73c2-9fb9-48f9-b0fc-766b66701b2c {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:12:48 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:12:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:48 devstack sudo[93924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c 1073741824
Jun 24 04:12:48 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:49 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c 1073741824" returned: 0 in 1.027s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:49 devstack sudo[94244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c
Jun 24 04:12:49 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:50 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c" returned: 0 in 0.685s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:12:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c78ffd-17e8-4fdc-98e9-83c12c79feb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ef3c63-6468-4883-b726-3582a033f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:50 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Volume volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c (0bbb73c2-9fb9-48f9-b0fc-766b66701b2c): created successfully
Jun 24 04:12:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ef3c63-6468-4883-b726-3582a033f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Flow 'volume_create_manager' (51b3dff1-be56-47a2-90ba-b7a7eff3848c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:12:50 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-80ed7afb-ee98-416b-8481-a0373165777f tempest-TaggedAttachmentsTest-7949658 None] Created volume successfully.
Jun 24 04:13:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=5,cinder:INSERT=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:13:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Flow 'volume_create_manager' (bdb93ddb-8a57-461c-b795-144b92de812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ce1489-e4c7-4169-8e67-05686e00e45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ce1489-e4c7-4169-8e67-05686e00e45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1596023825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51592e84-ca58-4c0f-b20f-06f03cec975a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77a2149dbe94b8fb2aeda5c158685fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:15Z,use_quota=True,user_id='a5980fca390b4698be5ffee721a925ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4415cd9b-a806-4bf2-9f0e-655ee84dcccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4415cd9b-a806-4bf2-9f0e-655ee84dcccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a989f014-0647-4a84-b77d-47fe14cab5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a989f014-0647-4a84-b77d-47fe14cab5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51592e84-ca58-4c0f-b20f-06f03cec975a', 'volume_name': 'volume-51592e84-ca58-4c0f-b20f-06f03cec975a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fd8e0d-c249-44de-8744-510081350676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fd8e0d-c249-44de-8744-510081350676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec168cd-b68a-41da-933d-55e6942becaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:15 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Volume 51592e84-ca58-4c0f-b20f-06f03cec975a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51592e84-ca58-4c0f-b20f-06f03cec975a', 'volume_size': 1}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1596023825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51592e84-ca58-4c0f-b20f-06f03cec975a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77a2149dbe94b8fb2aeda5c158685fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:15Z,use_quota=True,user_id='a5980fca390b4698be5ffee721a925ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Creating volume 51592e84-ca58-4c0f-b20f-06f03cec975a {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:13:15 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:13:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:15 devstack sudo[94549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a 1073741824
Jun 24 04:13:15 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:16 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a 1073741824" returned: 0 in 1.558s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:17 devstack sudo[94564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a
Jun 24 04:13:17 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:17 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a" returned: 0 in 0.962s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] <== create_volume: return (2631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:13:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.634s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec168cd-b68a-41da-933d-55e6942becaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51592e84-ca58-4c0f-b20f-06f03cec975a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ef623-0d07-4c54-a1d2-3a04f87a9f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:18 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Volume volume-51592e84-ca58-4c0f-b20f-06f03cec975a (51592e84-ca58-4c0f-b20f-06f03cec975a): created successfully
Jun 24 04:13:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ef623-0d07-4c54-a1d2-3a04f87a9f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Flow 'volume_create_manager' (bdb93ddb-8a57-461c-b795-144b92de812e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:18 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9c8f24ac-b892-4458-8f4e-b364095abc6b tempest-DeleteServersTestJSON-1284310325 None] Created volume successfully.
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Flow 'volume_create_manager' (231bd671-e80f-495d-8124-f30c6ea1777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb57ec6-bb4f-4858-8901-ab2eb1c7cb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb57ec6-bb4f-4858-8901-ab2eb1c7cb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-10393708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3748d8f-212e-4341-9f64-617bc62ccb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4561fd20a34659958f2e47acaf723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:26Z,use_quota=True,user_id='790969ff9a0442e9b4db96aa9d5bd7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1126de-8355-45eb-87c6-8c17c315887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1126de-8355-45eb-87c6-8c17c315887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f8b402-c433-4268-94f4-d7b53daebfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f8b402-c433-4268-94f4-d7b53daebfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3748d8f-212e-4341-9f64-617bc62ccb6a', 'volume_name': 'volume-a3748d8f-212e-4341-9f64-617bc62ccb6a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2048ca94-1a80-4ee9-bd16-e1536cd07ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2048ca94-1a80-4ee9-bd16-e1536cd07ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8a1c3b-c51b-4d5b-a116-7016c4053d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:26 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Volume a3748d8f-212e-4341-9f64-617bc62ccb6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3748d8f-212e-4341-9f64-617bc62ccb6a', 'volume_size': 1}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-10393708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3748d8f-212e-4341-9f64-617bc62ccb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4561fd20a34659958f2e47acaf723b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:26Z,use_quota=True,user_id='790969ff9a0442e9b4db96aa9d5bd7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Creating volume a3748d8f-212e-4341-9f64-617bc62ccb6a {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:13:26 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:13:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:26 devstack sudo[94798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a 1073741824
Jun 24 04:13:26 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:27 devstack cinder-volume[93470]: WARNING py.warnings [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jun 24 04:13:27 devstack cinder-volume[93470]:   .first()
Jun 24 04:13:27 devstack cinder-volume[93470]: 
Jun 24 04:13:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:27 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a 1073741824" returned: 0 in 1.591s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:28 devstack sudo[94819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a
Jun 24 04:13:28 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:29 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a" returned: 0 in 1.139s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] <== create_volume: return (2785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:13:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.787s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.155s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:29 devstack cinder-volume[93470]: INFO oslo.privsep.daemon [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9nzv9m3t/privsep.sock']
Jun 24 04:13:29 devstack sudo[94822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9nzv9m3t/privsep.sock
Jun 24 04:13:29 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8a1c3b-c51b-4d5b-a116-7016c4053d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3748d8f-212e-4341-9f64-617bc62ccb6a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b8162c-742b-4324-b9ea-1978db819641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:29 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Volume volume-a3748d8f-212e-4341-9f64-617bc62ccb6a (a3748d8f-212e-4341-9f64-617bc62ccb6a): created successfully
Jun 24 04:13:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b8162c-742b-4324-b9ea-1978db819641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Flow 'volume_create_manager' (231bd671-e80f-495d-8124-f30c6ea1777d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:29 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f7a10c8f-dcb2-406b-a453-5f5d42017bdb tempest-VolumesAdminNegativeTest-1638930115 None] Created volume successfully.
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 24 04:13:30 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 24 04:13:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Acquiring lock "cinder-a3748d8f-212e-4341-9f64-617bc62ccb6a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Lock "cinder-a3748d8f-212e-4341-9f64-617bc62ccb6a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Acquiring lock "cinder-quobyte-a3748d8f-212e-4341-9f64-617bc62ccb6a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Lock "cinder-quobyte-a3748d8f-212e-4341-9f64-617bc62ccb6a" acquired by "delete_volume" :: waited 0.067s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 24 04:13:31 devstack cinder-volume[93470]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 24 04:13:32 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:32 devstack cinder-volume[93470]: INFO oslo.privsep.daemon [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] Spawned new privsep daemon via rootwrap
Jun 24 04:13:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] Accepted privsep connection to /tmp/tmp9nzv9m3t/privsep.sock {{(pid=93470) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jun 24 04:13:32 devstack cinder-volume[93470]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 24 04:13:32 devstack cinder-volume[93470]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 24 04:13:32 devstack cinder-volume[93470]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 24 04:13:32 devstack cinder-volume[93470]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94826
Jun 24 04:13:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bfe763-79a6-4ee9-a146-320970c27c74]: (2,) {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:32 devstack cinder-volume[93470]: WARNING oslo_privsep.priv_context [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] privsep daemon already running
Jun 24 04:13:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f1c298-6556-4ca6-85e5-fd59854dc10a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aab3a21-4693-4dad-bf96-c4f88e72cfcf]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:32 devstack sudo[94830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a
Jun 24 04:13:32 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:32 devstack sudo[94829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a
Jun 24 04:13:32 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:34 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a" returned: 0 in 1.671s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.032s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-51592e84-ca58-4c0f-b20f-06f03cec975a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00f5f4ee-4f99-4355-86a0-0bcd94854754', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:13:34 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-9a03a814-831a-4bf5-865f-4b5f263ddbc1 req-484193f8-df55-40fd-8201-b9be71c7b3f7 tempest-DeleteServersTestJSON-1284310325 None] attachment_update completed successfully.
Jun 24 04:13:34 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a" returned: 0 in 2.114s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:34 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a
Jun 24 04:13:34 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:36 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a3748d8f-212e-4341-9f64-617bc62ccb6a" returned: 0 in 1.861s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Lock "cinder-quobyte-a3748d8f-212e-4341-9f64-617bc62ccb6a" released by "delete_volume" :: held 5.496s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:36 devstack cinder-volume[93470]: WARNING cinder.quota [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:13:36 devstack cinder-volume[93470]: WARNING cinder.quota [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:13:36 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Created reservations ['8fb5b7f3-5988-41dc-98aa-ac76b62f3d3e', '91ce0b0a-00b0-4a04-a879-f6aa27b4d501', '0997a1cd-6c00-469c-979b-782fdc1dbbc3', 'f214b61c-33b9-4dd8-8855-2a53590c6be9'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:37 devstack sudo[94975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:13:37 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:38 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.448s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:38 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Deleted volume successfully.
Jun 24 04:13:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db865c25-e945-4c0f-8484-8282e8ea7a4a tempest-VolumesAdminNegativeTest-1638930115 None] Lock "cinder-a3748d8f-212e-4341-9f64-617bc62ccb6a-delete_volume" released by "delete_volume" :: held 7.627s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:13:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:45 devstack sudo[95439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:13:45 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:46 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.814s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:13:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 8 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:13:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:13:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-69d7cb16-6cbe-463e-8ea2-27c7111eae60 req-e1385320-3541-4654-84a7-ec2b6fff4147 tempest-DeleteServersTestJSON-1284310325 None] Terminate volume connection completed successfully.
Jun 24 04:13:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-69d7cb16-6cbe-463e-8ea2-27c7111eae60 req-e1385320-3541-4654-84a7-ec2b6fff4147 tempest-DeleteServersTestJSON-1284310325 None] Deleting attachment 00f5f4ee-4f99-4355-86a0-0bcd94854754. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:13:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Acquiring lock "cinder-51592e84-ca58-4c0f-b20f-06f03cec975a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Lock "cinder-51592e84-ca58-4c0f-b20f-06f03cec975a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Acquiring lock "cinder-quobyte-51592e84-ca58-4c0f-b20f-06f03cec975a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Lock "cinder-quobyte-51592e84-ca58-4c0f-b20f-06f03cec975a" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:50 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac197e91-5bda-4092-a3bc-234e2fea460f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:50 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a
Jun 24 04:13:50 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:51 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a" returned: 0 in 0.840s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:51 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a
Jun 24 04:13:51 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-51592e84-ca58-4c0f-b20f-06f03cec975a" returned: 0 in 0.788s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:52 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Lock "cinder-quobyte-51592e84-ca58-4c0f-b20f-06f03cec975a" released by "delete_volume" :: held 1.692s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Created reservations ['22f7da54-fecb-4a3f-b2d0-1a9d5f403766', 'd523dae3-7f09-4172-ac51-09bbf469b805', '3d0be0d3-1001-4471-8e59-dc683ff43bef', 'e1008bc9-2824-4bc6-aff2-9fb0f0469492'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:52 devstack sudo[95469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:13:52 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:53 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.190s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:53 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Deleted volume successfully.
Jun 24 04:13:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7e925a2f-2da5-42f9-9b8e-70ec0aba6cc9 tempest-DeleteServersTestJSON-1284310325 None] Lock "cinder-51592e84-ca58-4c0f-b20f-06f03cec975a-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:02 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=23,cinder:SELECT=24,cinder:INSERT=5 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:14:03 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=18,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=4 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:14:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-595780d0-2529-4eb5-95ed-fd19f9b4bf2c req-46dc15ca-5597-4131-a8ef-b76e35f551a6 tempest-TaggedAttachmentsTest-7949658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-595780d0-2529-4eb5-95ed-fd19f9b4bf2c req-46dc15ca-5597-4131-a8ef-b76e35f551a6 tempest-TaggedAttachmentsTest-7949658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:14 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5a2e65-37c8-4647-9eaa-1e5853a0290e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-595780d0-2529-4eb5-95ed-fd19f9b4bf2c req-46dc15ca-5597-4131-a8ef-b76e35f551a6 tempest-TaggedAttachmentsTest-7949658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:14 devstack sudo[95703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c
Jun 24 04:14:14 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:15 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-595780d0-2529-4eb5-95ed-fd19f9b4bf2c req-46dc15ca-5597-4131-a8ef-b76e35f551a6 tempest-TaggedAttachmentsTest-7949658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c" returned: 0 in 0.963s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-595780d0-2529-4eb5-95ed-fd19f9b4bf2c req-46dc15ca-5597-4131-a8ef-b76e35f551a6 tempest-TaggedAttachmentsTest-7949658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.988s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-595780d0-2529-4eb5-95ed-fd19f9b4bf2c req-46dc15ca-5597-4131-a8ef-b76e35f551a6 tempest-TaggedAttachmentsTest-7949658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c39bdcf6-e7bf-4310-acac-9c71048736d2', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:14:15 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-595780d0-2529-4eb5-95ed-fd19f9b4bf2c req-46dc15ca-5597-4131-a8ef-b76e35f551a6 tempest-TaggedAttachmentsTest-7949658 None] attachment_update completed successfully.
Jun 24 04:14:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-57ccb209-a41a-4a8a-95a4-f128d7c9d46d req-fe45d0e1-bdc5-4d38-981d-cc077ecfccbd tempest-TaggedAttachmentsTest-7949658 None] Terminate volume connection completed successfully.
Jun 24 04:14:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-57ccb209-a41a-4a8a-95a4-f128d7c9d46d req-fe45d0e1-bdc5-4d38-981d-cc077ecfccbd tempest-TaggedAttachmentsTest-7949658 None] Deleting attachment c39bdcf6-e7bf-4310-acac-9c71048736d2. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:14:25 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:14:33 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:14:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:14:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:45 devstack sudo[96596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:14:45 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:46 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.630s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:14:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 8 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:14:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:14:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Acquiring lock "cinder-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Lock "cinder-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Acquiring lock "cinder-quobyte-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Lock "cinder-quobyte-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c" acquired by "delete_volume" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:50 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392e0be-a3a3-47a9-8167-6ce80ae7dec6]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:50 devstack sudo[96609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c
Jun 24 04:14:50 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Flow 'volume_create_manager' (de3e7929-f30a-4c5e-bfe2-15943532d982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915da289-fdfd-4351-aa6e-ebb8c18bd367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915da289-fdfd-4351-aa6e-ebb8c18bd367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-561850378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb31d28f-6a3c-4efa-9698-75cdeb704f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de1235eadfa4bc6acb6fd1f12b68067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:51Z,use_quota=True,user_id='cd3e2a77a96d4255a3ba1cc96c4de5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa0420c-12c4-41c8-8ffe-1733a2f7d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa0420c-12c4-41c8-8ffe-1733a2f7d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd0037d-25e8-4bf1-8611-6499052030e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd0037d-25e8-4bf1-8611-6499052030e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb31d28f-6a3c-4efa-9698-75cdeb704f73', 'volume_name': 'volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5365468b-82da-4299-a508-5c4409b75f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5365468b-82da-4299-a508-5c4409b75f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4982c2-1d16-481b-9d9f-fc92d684e128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Volume eb31d28f-6a3c-4efa-9698-75cdeb704f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73', 'volume_size': 1}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-561850378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb31d28f-6a3c-4efa-9698-75cdeb704f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de1235eadfa4bc6acb6fd1f12b68067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:51Z,use_quota=True,user_id='cd3e2a77a96d4255a3ba1cc96c4de5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Creating volume eb31d28f-6a3c-4efa-9698-75cdeb704f73 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:14:51 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:51 devstack sudo[96611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73 1073741824
Jun 24 04:14:51 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:51 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c" returned: 0 in 1.440s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:51 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c
Jun 24 04:14:51 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:52 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73 1073741824" returned: 0 in 1.349s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:52 devstack sudo[96623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73
Jun 24 04:14:52 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:53 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c" returned: 0 in 1.162s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Lock "cinder-quobyte-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c" released by "delete_volume" :: held 2.715s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Created reservations ['4884c929-9f05-4361-a170-922449a401e8', 'f5cf30cc-366c-448a-af0e-6fcb92bdc8e2', 'b7c93d4a-0af9-49ba-8d19-8c7846fe6bf5', 'deca8c00-34bb-4508-8526-bf05fc798a25'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:53 devstack sudo[96629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:14:53 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:53 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73" returned: 0 in 1.054s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] <== create_volume: return (2476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.481s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4982c2-1d16-481b-9d9f-fc92d684e128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2fb118-f20e-4a69-8826-0618a833a61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:53 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Volume volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73 (eb31d28f-6a3c-4efa-9698-75cdeb704f73): created successfully
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2fb118-f20e-4a69-8826-0618a833a61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Flow 'volume_create_manager' (de3e7929-f30a-4c5e-bfe2-15943532d982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b992d870-a43e-4d16-ab50-d3f7974d025d tempest-ServersNegativeTestJSON-1139191787 None] Created volume successfully.
Jun 24 04:14:54 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.908s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:54 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:54 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Deleted volume successfully.
Jun 24 04:14:54 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4ff7acb3-53d1-4524-b59f-88d89d81c727 tempest-TaggedAttachmentsTest-7949658 None] Lock "cinder-0bbb73c2-9fb9-48f9-b0fc-766b66701b2c-delete_volume" released by "delete_volume" :: held 4.041s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Flow 'volume_create_manager' (584afe5b-97df-45fb-a33a-efd9bcf95c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574a3cb6-2e93-42e1-9c4d-a6ed3cf16506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574a3cb6-2e93-42e1-9c4d-a6ed3cf16506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-439001248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd4adf1-2914-4825-92c0-941ad3f23dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de1235eadfa4bc6acb6fd1f12b68067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:56Z,use_quota=True,user_id='cd3e2a77a96d4255a3ba1cc96c4de5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d8b3ca-7ef5-4f0c-b28f-e74ee4ffca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d8b3ca-7ef5-4f0c-b28f-e74ee4ffca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72eb44c-34ac-416b-b1cf-c2e2991d2feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72eb44c-34ac-416b-b1cf-c2e2991d2feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd4adf1-2914-4825-92c0-941ad3f23dc7', 'volume_name': 'volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827909dc-ec26-42e2-ac43-c65d4ac7e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827909dc-ec26-42e2-ac43-c65d4ac7e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461d3bd3-fb32-425b-853e-6e488e8d0bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:56 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Volume 5fd4adf1-2914-4825-92c0-941ad3f23dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7', 'volume_size': 1}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-439001248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd4adf1-2914-4825-92c0-941ad3f23dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de1235eadfa4bc6acb6fd1f12b68067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:56Z,use_quota=True,user_id='cd3e2a77a96d4255a3ba1cc96c4de5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Creating volume 5fd4adf1-2914-4825-92c0-941ad3f23dc7 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:14:56 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:14:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:56 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7 1073741824
Jun 24 04:14:56 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:57 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7 1073741824" returned: 0 in 1.181s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:57 devstack sudo[96685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7
Jun 24 04:14:57 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:58 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7" returned: 0 in 1.014s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:14:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461d3bd3-fb32-425b-853e-6e488e8d0bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac4c45e-59fc-4332-bcdb-cc380c7b4209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:58 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Volume volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7 (5fd4adf1-2914-4825-92c0-941ad3f23dc7): created successfully
Jun 24 04:14:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac4c45e-59fc-4332-bcdb-cc380c7b4209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Flow 'volume_create_manager' (584afe5b-97df-45fb-a33a-efd9bcf95c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:58 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-45953c0c-bb8c-4d52-87a6-832057eab178 tempest-ServersNegativeTestJSON-1139191787 None] Created volume successfully.
Jun 24 04:14:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "cinder-5fd4adf1-2914-4825-92c0-941ad3f23dc7-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Lock "cinder-5fd4adf1-2914-4825-92c0-941ad3f23dc7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "cinder-quobyte-5fd4adf1-2914-4825-92c0-941ad3f23dc7" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Lock "cinder-quobyte-5fd4adf1-2914-4825-92c0-941ad3f23dc7" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:59 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cda96ef-b261-4dd5-af6a-47224fcd31d6]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:00 devstack sudo[96702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7
Jun 24 04:15:00 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:01 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7" returned: 0 in 1.204s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:01 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7
Jun 24 04:15:01 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:01 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5fd4adf1-2914-4825-92c0-941ad3f23dc7" returned: 0 in 0.750s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Lock "cinder-quobyte-5fd4adf1-2914-4825-92c0-941ad3f23dc7" released by "delete_volume" :: held 2.021s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:01 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Created reservations ['4e018066-d2e6-4066-9abd-76da7c5ef50f', 'f3918255-4695-41d4-b7ed-8be47926792e', 'cff2851a-0151-44dc-adbf-3434247b1945', '991b2e39-4acb-4f7c-9c66-d340be1a5536'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:15:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:02 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:15:02 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "cinder-eb31d28f-6a3c-4efa-9698-75cdeb704f73-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Lock "cinder-eb31d28f-6a3c-4efa-9698-75cdeb704f73-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "cinder-quobyte-eb31d28f-6a3c-4efa-9698-75cdeb704f73" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Lock "cinder-quobyte-eb31d28f-6a3c-4efa-9698-75cdeb704f73" acquired by "delete_volume" :: waited 0.044s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad9aa38-1699-4e45-b86d-00a26def8067]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:02 devstack sudo[96751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73
Jun 24 04:15:02 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.881s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:02 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:02 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Deleted volume successfully.
Jun 24 04:15:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d387a04d-a330-4ec8-b6c0-6b986c0c37fe tempest-ServersNegativeTestJSON-1139191787 None] Lock "cinder-5fd4adf1-2914-4825-92c0-941ad3f23dc7-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:03 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73" returned: 0 in 0.951s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:03 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73
Jun 24 04:15:03 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:03 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-eb31d28f-6a3c-4efa-9698-75cdeb704f73" returned: 0 in 0.675s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Lock "cinder-quobyte-eb31d28f-6a3c-4efa-9698-75cdeb704f73" released by "delete_volume" :: held 1.673s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:03 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Created reservations ['0c707fb5-5ab3-43a7-bfd2-d9276eb3e56c', '3a35d843-2f71-4ac3-b443-b494a12331a4', 'd60602c9-f302-47e4-8179-0a897b310b51', 'f4a7d0a9-d3fe-4944-83c0-26775cf0de12'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:04 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:15:04 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:04 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.699s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Deleted volume successfully.
Jun 24 04:15:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da450de7-d4c3-49b1-baa1-06acd67fc204 tempest-ServersNegativeTestJSON-1139191787 None] Lock "cinder-eb31d28f-6a3c-4efa-9698-75cdeb704f73-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Flow 'volume_create_manager' (23e248a1-b783-4136-868e-90c8b2bae2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed194b2b-4b30-4a2a-bfa9-be08b8131464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed194b2b-4b30-4a2a-bfa9-be08b8131464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2092833374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a88815-f835-4ec6-8f66-c4447bcf2df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936f6acf251a40fbae06d8ffec8f8f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:08Z,use_quota=True,user_id='466d20178fff40f5a4d2a6f36983a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5445bb33-f706-4ea9-beec-2e2a29580c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5445bb33-f706-4ea9-beec-2e2a29580c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21690c8-b721-429a-b4e2-eec717384e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21690c8-b721-429a-b4e2-eec717384e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a88815-f835-4ec6-8f66-c4447bcf2df8', 'volume_name': 'volume-68a88815-f835-4ec6-8f66-c4447bcf2df8', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e82ce38-fc67-46e0-8190-20a8bbb5d693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e82ce38-fc67-46e0-8190-20a8bbb5d693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4bd137-3738-4605-9d2f-a902db453d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:08 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Volume 68a88815-f835-4ec6-8f66-c4447bcf2df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a88815-f835-4ec6-8f66-c4447bcf2df8', 'volume_size': 1}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2092833374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a88815-f835-4ec6-8f66-c4447bcf2df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936f6acf251a40fbae06d8ffec8f8f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:08Z,use_quota=True,user_id='466d20178fff40f5a4d2a6f36983a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Creating volume 68a88815-f835-4ec6-8f66-c4447bcf2df8 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:15:08 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:15:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:08 devstack sudo[96857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8 1073741824
Jun 24 04:15:08 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:09 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8 1073741824" returned: 0 in 0.993s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:09 devstack sudo[96863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8
Jun 24 04:15:09 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:10 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8" returned: 0 in 0.804s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:15:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4bd137-3738-4605-9d2f-a902db453d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a88815-f835-4ec6-8f66-c4447bcf2df8', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7155d596-67ba-4d40-8787-c6018d53cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:10 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Volume volume-68a88815-f835-4ec6-8f66-c4447bcf2df8 (68a88815-f835-4ec6-8f66-c4447bcf2df8): created successfully
Jun 24 04:15:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7155d596-67ba-4d40-8787-c6018d53cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Flow 'volume_create_manager' (23e248a1-b783-4136-868e-90c8b2bae2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0dff0487-6a1f-4335-8e7c-80852fa13097 tempest-AttachVolumeTestJSON-1434652702 None] Created volume successfully.
Jun 24 04:15:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-61294bb2-3a04-4330-b094-634745b7d265 req-6f867fd7-18fd-453d-88e8-c25bf5a4ad4d tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-61294bb2-3a04-4330-b094-634745b7d265 req-6f867fd7-18fd-453d-88e8-c25bf5a4ad4d tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:13 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38c6d0f-01b3-40e1-8359-566560df84b9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-61294bb2-3a04-4330-b094-634745b7d265 req-6f867fd7-18fd-453d-88e8-c25bf5a4ad4d tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:13 devstack sudo[96883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8
Jun 24 04:15:13 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:14 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-61294bb2-3a04-4330-b094-634745b7d265 req-6f867fd7-18fd-453d-88e8-c25bf5a4ad4d tempest-AttachVolumeTestJSON-1434652702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8" returned: 0 in 0.981s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-61294bb2-3a04-4330-b094-634745b7d265 req-6f867fd7-18fd-453d-88e8-c25bf5a4ad4d tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-61294bb2-3a04-4330-b094-634745b7d265 req-6f867fd7-18fd-453d-88e8-c25bf5a4ad4d tempest-AttachVolumeTestJSON-1434652702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-68a88815-f835-4ec6-8f66-c4447bcf2df8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6f2602d-8771-4060-a48d-3754438f377b', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:15:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-61294bb2-3a04-4330-b094-634745b7d265 req-6f867fd7-18fd-453d-88e8-c25bf5a4ad4d tempest-AttachVolumeTestJSON-1434652702 None] attachment_update completed successfully.
Jun 24 04:15:15 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Flow 'volume_create_manager' (641b6615-4a70-456f-aabf-1259d944c622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac8a3c9-c5c3-4427-99e7-7829ef0cb19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac8a3c9-c5c3-4427-99e7-7829ef0cb19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1772194560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2dabf3-d555-48d6-9137-2da4897c3c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906c95bae7054393bf527c9277e7c3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:16Z,use_quota=True,user_id='6abc8c253f494357ae91df4c05568dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ea38d4-4f35-4d72-b823-60d4b3d460e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ea38d4-4f35-4d72-b823-60d4b3d460e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013b9eeb-12c5-4d00-96ef-6820116e625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013b9eeb-12c5-4d00-96ef-6820116e625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f2dabf3-d555-48d6-9137-2da4897c3c68', 'volume_name': 'volume-0f2dabf3-d555-48d6-9137-2da4897c3c68', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f593631-242a-4a42-8b4a-cc7c98e7b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f593631-242a-4a42-8b4a-cc7c98e7b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9491d7-5130-462b-afa9-9ee9949cb1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Volume 0f2dabf3-d555-48d6-9137-2da4897c3c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f2dabf3-d555-48d6-9137-2da4897c3c68', 'volume_size': 1}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1772194560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2dabf3-d555-48d6-9137-2da4897c3c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906c95bae7054393bf527c9277e7c3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:16Z,use_quota=True,user_id='6abc8c253f494357ae91df4c05568dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Creating volume 0f2dabf3-d555-48d6-9137-2da4897c3c68 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:15:16 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:15:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:16 devstack sudo[96958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 1073741824
Jun 24 04:15:16 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:17 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 1073741824" returned: 0 in 1.239s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:17 devstack sudo[97281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68
Jun 24 04:15:17 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:18 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68" returned: 0 in 0.847s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:15:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9491d7-5130-462b-afa9-9ee9949cb1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2dabf3-d555-48d6-9137-2da4897c3c68', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aea9bb5-753c-4dad-a182-4f8bc256dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:18 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Volume volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 (0f2dabf3-d555-48d6-9137-2da4897c3c68): created successfully
Jun 24 04:15:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aea9bb5-753c-4dad-a182-4f8bc256dd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Flow 'volume_create_manager' (641b6615-4a70-456f-aabf-1259d944c622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:18 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9d2b7beb-b1c4-45b9-8556-2947871c3188 tempest-ServerActionsTestOtherA-189006233 None] Created volume successfully.
Jun 24 04:15:21 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Flow 'volume_create_manager' (6783f528-aad7-45e1-96cc-b92cb641ba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4f4ce6-6716-4143-aae8-c4c2f9362697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4f4ce6-6716-4143-aae8-c4c2f9362697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-804598624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1effee-28eb-4328-948a-2d4720c48ce2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34b0ed278bd945129cdcdf4c282f722b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:22Z,use_quota=True,user_id='91b55f2e5eb543c5831548a01425f08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d97ad5b-4200-4619-b57f-fb612ff11210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d97ad5b-4200-4619-b57f-fb612ff11210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342771cd-6a28-4608-972c-7d4f0756fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342771cd-6a28-4608-972c-7d4f0756fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1effee-28eb-4328-948a-2d4720c48ce2', 'volume_name': 'volume-9f1effee-28eb-4328-948a-2d4720c48ce2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279272ee-09fc-432a-bc83-12484a54f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279272ee-09fc-432a-bc83-12484a54f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83a0b15-ec93-43a5-9f73-a9efeeb22726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:22 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Volume 9f1effee-28eb-4328-948a-2d4720c48ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1effee-28eb-4328-948a-2d4720c48ce2', 'volume_size': 1}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-804598624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1effee-28eb-4328-948a-2d4720c48ce2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34b0ed278bd945129cdcdf4c282f722b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:22Z,use_quota=True,user_id='91b55f2e5eb543c5831548a01425f08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Creating volume 9f1effee-28eb-4328-948a-2d4720c48ce2 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:15:22 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:15:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:22 devstack sudo[97309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2 1073741824
Jun 24 04:15:22 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:23 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2 1073741824" returned: 0 in 0.990s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:23 devstack sudo[97352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2
Jun 24 04:15:23 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:23 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2" returned: 0 in 0.650s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83a0b15-ec93-43a5-9f73-a9efeeb22726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1effee-28eb-4328-948a-2d4720c48ce2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0513a5-6a12-43b1-914c-27e0358d3711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:23 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Volume volume-9f1effee-28eb-4328-948a-2d4720c48ce2 (9f1effee-28eb-4328-948a-2d4720c48ce2): created successfully
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0513a5-6a12-43b1-914c-27e0358d3711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Flow 'volume_create_manager' (6783f528-aad7-45e1-96cc-b92cb641ba61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-46179a56-279e-4614-9c39-e588f8a66c8b tempest-VolumesTestJSON-105866085 None] Created volume successfully.
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Flow 'volume_create_manager' (e98a6c4f-c7a5-4b40-9db0-27b26a815879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (674f130d-c458-4e45-b18b-cb5b6eda50a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (674f130d-c458-4e45-b18b-cb5b6eda50a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-858103921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d77706-00ca-44bf-9018-5751ef28e34d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34b0ed278bd945129cdcdf4c282f722b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:25Z,use_quota=True,user_id='91b55f2e5eb543c5831548a01425f08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2461c19-bf9a-4c0e-83ca-d7da9712fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2461c19-bf9a-4c0e-83ca-d7da9712fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a781f3e9-9cfb-4e7f-ab74-d15f92d5a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a781f3e9-9cfb-4e7f-ab74-d15f92d5a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d77706-00ca-44bf-9018-5751ef28e34d', 'volume_name': 'volume-83d77706-00ca-44bf-9018-5751ef28e34d', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfb0ecd-02f2-4795-abae-2e32342fb781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfb0ecd-02f2-4795-abae-2e32342fb781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef5268f-a899-4fb6-833a-ce1c55af206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:24 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Volume 83d77706-00ca-44bf-9018-5751ef28e34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d77706-00ca-44bf-9018-5751ef28e34d', 'volume_size': 1}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-858103921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d77706-00ca-44bf-9018-5751ef28e34d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34b0ed278bd945129cdcdf4c282f722b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:25Z,use_quota=True,user_id='91b55f2e5eb543c5831548a01425f08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Creating volume 83d77706-00ca-44bf-9018-5751ef28e34d {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:15:24 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:15:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:24 devstack sudo[97356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d 1073741824
Jun 24 04:15:24 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:25 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d 1073741824" returned: 0 in 1.245s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:26 devstack sudo[97366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d
Jun 24 04:15:26 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:26 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d" returned: 0 in 0.874s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:15:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef5268f-a899-4fb6-833a-ce1c55af206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d77706-00ca-44bf-9018-5751ef28e34d', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ea45d2-8d69-48e0-b017-0782cb95dce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:26 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Volume volume-83d77706-00ca-44bf-9018-5751ef28e34d (83d77706-00ca-44bf-9018-5751ef28e34d): created successfully
Jun 24 04:15:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ea45d2-8d69-48e0-b017-0782cb95dce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Flow 'volume_create_manager' (e98a6c4f-c7a5-4b40-9db0-27b26a815879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b9a7de46-b993-41fd-8ca9-133fe8e13141 tempest-VolumesTestJSON-105866085 None] Created volume successfully.
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Flow 'volume_create_manager' (e8d1a33e-e2db-4dde-8a17-2c22a55288d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb03fc6-71cf-466d-958a-d42887666d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb03fc6-71cf-466d-958a-d42887666d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-205294479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f88a1b9-0bf0-4681-8c9b-b49596de5d55,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34b0ed278bd945129cdcdf4c282f722b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:28Z,use_quota=True,user_id='91b55f2e5eb543c5831548a01425f08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5027d9cf-87d4-43cf-9179-adc6cc72b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5027d9cf-87d4-43cf-9179-adc6cc72b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c19232-6507-425b-94cd-779d269d5acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c19232-6507-425b-94cd-779d269d5acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f88a1b9-0bf0-4681-8c9b-b49596de5d55', 'volume_name': 'volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2b17eb-4a66-4f89-9a19-fa179ddb5c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2b17eb-4a66-4f89-9a19-fa179ddb5c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c85280-502f-49b7-945b-63dae7c5654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:28 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Volume 3f88a1b9-0bf0-4681-8c9b-b49596de5d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55', 'volume_size': 1}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-205294479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f88a1b9-0bf0-4681-8c9b-b49596de5d55,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34b0ed278bd945129cdcdf4c282f722b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:28Z,use_quota=True,user_id='91b55f2e5eb543c5831548a01425f08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Creating volume 3f88a1b9-0bf0-4681-8c9b-b49596de5d55 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:15:28 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:15:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:28 devstack sudo[97388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55 1073741824
Jun 24 04:15:28 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:29 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55 1073741824" returned: 0 in 1.169s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:29 devstack sudo[97434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55
Jun 24 04:15:29 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:30 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55" returned: 0 in 0.985s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:15:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c85280-502f-49b7-945b-63dae7c5654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c57e37-d71d-4ff2-94b8-a4033d3ef7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:30 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Volume volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55 (3f88a1b9-0bf0-4681-8c9b-b49596de5d55): created successfully
Jun 24 04:15:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c57e37-d71d-4ff2-94b8-a4033d3ef7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Flow 'volume_create_manager' (e8d1a33e-e2db-4dde-8a17-2c22a55288d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:30 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-350817d8-201e-494b-9563-0dbd0738e8f5 tempest-VolumesTestJSON-105866085 None] Created volume successfully.
Jun 24 04:15:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Acquiring lock "cinder-3f88a1b9-0bf0-4681-8c9b-b49596de5d55-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Lock "cinder-3f88a1b9-0bf0-4681-8c9b-b49596de5d55-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Acquiring lock "cinder-quobyte-3f88a1b9-0bf0-4681-8c9b-b49596de5d55" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Lock "cinder-quobyte-3f88a1b9-0bf0-4681-8c9b-b49596de5d55" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e9211d-c186-43a9-b641-f96779003a9c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:33 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55
Jun 24 04:15:33 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:34 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55" returned: 0 in 1.187s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:34 devstack sudo[97948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55
Jun 24 04:15:34 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:34 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3f88a1b9-0bf0-4681-8c9b-b49596de5d55" returned: 0 in 0.807s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Lock "cinder-quobyte-3f88a1b9-0bf0-4681-8c9b-b49596de5d55" released by "delete_volume" :: held 2.057s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:35 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Created reservations ['2a110ccd-a702-4f64-a216-6f6c999a9877', '9f5ba9ef-1a20-4821-ba2e-a29df640934c', 'f5c49133-af0b-4c3a-b80a-281bcb1f8d72', '54ea2040-450e-4c9b-84cc-1737e7168a2e'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:15:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:35 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:15:35 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Acquiring lock "cinder-83d77706-00ca-44bf-9018-5751ef28e34d-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Lock "cinder-83d77706-00ca-44bf-9018-5751ef28e34d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:36 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.348s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:36 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:36 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Deleted volume successfully.
Jun 24 04:15:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Acquiring lock "cinder-quobyte-83d77706-00ca-44bf-9018-5751ef28e34d" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Lock "cinder-quobyte-83d77706-00ca-44bf-9018-5751ef28e34d" acquired by "delete_volume" :: waited 0.040s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3ccc1021-da2a-4775-ba91-01a6d263c39a tempest-VolumesTestJSON-105866085 None] Lock "cinder-3f88a1b9-0bf0-4681-8c9b-b49596de5d55-delete_volume" released by "delete_volume" :: held 4.101s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2701f4c0-30c9-4fdc-9194-8290fe50ef4f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:37 devstack sudo[98156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d
Jun 24 04:15:37 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:39 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d" returned: 0 in 2.721s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:39 devstack sudo[98230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d
Jun 24 04:15:39 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:41 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-83d77706-00ca-44bf-9018-5751ef28e34d" returned: 0 in 1.835s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Lock "cinder-quobyte-83d77706-00ca-44bf-9018-5751ef28e34d" released by "delete_volume" :: held 4.702s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Created reservations ['07e10cc0-c8a2-42cd-8074-0351a2ff60e4', 'd8116648-0fd6-4214-86c9-2792103a45ff', '56a1e6a4-9dee-434f-bb41-6552ea458397', '5d0d0ced-97c7-4622-9b12-c8191557f1d1'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:42 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:15:42 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Acquiring lock "cinder-9f1effee-28eb-4328-948a-2d4720c48ce2-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Lock "cinder-9f1effee-28eb-4328-948a-2d4720c48ce2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Acquiring lock "cinder-quobyte-9f1effee-28eb-4328-948a-2d4720c48ce2" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Lock "cinder-quobyte-9f1effee-28eb-4328-948a-2d4720c48ce2" acquired by "delete_volume" :: waited 0.056s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:43 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[72750587-9921-48a8-9757-36639a8021db]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:43 devstack sudo[98259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2
Jun 24 04:15:43 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:43 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.708s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:43 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Deleted volume successfully.
Jun 24 04:15:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f9ececbb-4e3d-45f1-ab47-7739d72fb72a tempest-VolumesTestJSON-105866085 None] Lock "cinder-83d77706-00ca-44bf-9018-5751ef28e34d-delete_volume" released by "delete_volume" :: held 7.118s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:44 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2" returned: 0 in 1.572s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:44 devstack sudo[98267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2
Jun 24 04:15:44 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:15:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:45 devstack sudo[98272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:15:45 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:46 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f1effee-28eb-4328-948a-2d4720c48ce2" returned: 0 in 1.398s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Lock "cinder-quobyte-9f1effee-28eb-4328-948a-2d4720c48ce2" released by "delete_volume" :: held 3.107s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=52,cinder:UPDATE=64,cinder:INSERT=12,cinder:DELETE=6 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=62,cinder:SELECT=41,cinder:INSERT=15,cinder:DELETE=6 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Created reservations ['8b146135-1891-490b-9c17-75e8e2d54734', '5881283f-bae2-4791-a640-1a8288d026bd', '592f56cf-6e88-422f-904c-3a8c841d7fce', '225fa471-aa3c-4edd-9e8c-66bf0ffaf13b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:46 devstack sudo[98276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:15:46 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:46 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.457s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 8 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:15:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:15:47 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.413s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:47 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:47 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Deleted volume successfully.
Jun 24 04:15:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b9219336-4f4d-4fb0-90e7-c74df8ce7174 tempest-VolumesTestJSON-105866085 None] Lock "cinder-9f1effee-28eb-4328-948a-2d4720c48ce2-delete_volume" released by "delete_volume" :: held 5.207s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:16:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=3,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Flow 'volume_create_manager' (d49c5964-e15d-4d4c-96ea-d067bb99e7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c4f0a3-acf5-4753-8e1f-51689b59cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c4f0a3-acf5-4753-8e1f-51689b59cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-733478889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c539b728c08b4361badbe0428ec96556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:02Z,use_quota=True,user_id='b1c1d25a2d5b4ecc98b9616513a53904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e67d01-d4cd-4e64-93c6-ccdbe9856134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e67d01-d4cd-4e64-93c6-ccdbe9856134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e7eb96-b3fd-424a-b7f8-0362d5a72469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e7eb96-b3fd-424a-b7f8-0362d5a72469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a', 'volume_name': 'volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705d0979-f115-4806-b7fd-93caa9f09268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705d0979-f115-4806-b7fd-93caa9f09268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f024e73d-36b3-46f7-a9ce-65e503ad8565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:02 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Volume 5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a', 'volume_size': 1}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-733478889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c539b728c08b4361badbe0428ec96556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:02Z,use_quota=True,user_id='b1c1d25a2d5b4ecc98b9616513a53904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Creating volume 5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:02 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:16:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:02 devstack sudo[98521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a 1073741824
Jun 24 04:16:02 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:03 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a 1073741824" returned: 0 in 0.969s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:03 devstack sudo[98528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a
Jun 24 04:16:03 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:03 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a" returned: 0 in 0.684s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f024e73d-36b3-46f7-a9ce-65e503ad8565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642b01c5-44fa-4dc9-a2c8-6a21e8915544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:03 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Volume volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a (5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a): created successfully
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642b01c5-44fa-4dc9-a2c8-6a21e8915544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Flow 'volume_create_manager' (d49c5964-e15d-4d4c-96ea-d067bb99e7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:03 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-5f0bfdcf-cc77-4f71-b82e-a1d6d7b767d4 tempest-ServerRescueNegativeTestJSON-214601606 None] Created volume successfully.
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Flow 'volume_create_manager' (b4bf23d3-dc0a-4dfb-9c30-64d32e1e53e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8dad20-c6c9-405d-bbf8-350c5a2ea2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8dad20-c6c9-405d-bbf8-350c5a2ea2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-88999999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d43fc3-5b43-47c7-8d01-1ae01af75dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d5164193c249149b5b066567d7c3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:12Z,use_quota=True,user_id='d49898113ee9495b9a4788e04b6f7dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3bf511-b918-4b29-8c05-aab9e5c99268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3bf511-b918-4b29-8c05-aab9e5c99268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf10fb9-f1d0-40f8-a57e-911c90b95841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf10fb9-f1d0-40f8-a57e-911c90b95841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d43fc3-5b43-47c7-8d01-1ae01af75dac', 'volume_name': 'volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72eccff8-613f-44cb-b63d-fbb6b8399253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72eccff8-613f-44cb-b63d-fbb6b8399253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3173aab5-446f-45f1-8cfc-79dcb9b0b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:11 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac', 'volume_size': 1}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-88999999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d43fc3-5b43-47c7-8d01-1ae01af75dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d5164193c249149b5b066567d7c3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:12Z,use_quota=True,user_id='d49898113ee9495b9a4788e04b6f7dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Creating volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:11 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:16:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:12 devstack sudo[98641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac 1073741824
Jun 24 04:16:12 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-e2a23fe8-8f96-4b00-97bc-e22c4263fec7 req-8ec28863-6f11-48d2-8f84-de1bff7b50b3 tempest-ServerActionsTestOtherA-189006233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:12 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac 1073741824" returned: 0 in 0.953s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:12 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac
Jun 24 04:16:12 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:13 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac" returned: 0 in 0.683s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-e2a23fe8-8f96-4b00-97bc-e22c4263fec7 req-8ec28863-6f11-48d2-8f84-de1bff7b50b3 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.097s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3173aab5-446f-45f1-8cfc-79dcb9b0b130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dd548b-5fe2-477f-a924-3668793bd58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec44c01-3927-4fe3-a02e-d7decab6688e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-e2a23fe8-8f96-4b00-97bc-e22c4263fec7 req-8ec28863-6f11-48d2-8f84-de1bff7b50b3 tempest-ServerActionsTestOtherA-189006233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:13 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Volume volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac (80d43fc3-5b43-47c7-8d01-1ae01af75dac): created successfully
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dd548b-5fe2-477f-a924-3668793bd58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Flow 'volume_create_manager' (b4bf23d3-dc0a-4dfb-9c30-64d32e1e53e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:13 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-21658048-eee2-4d17-8837-8b8d30a61b7a tempest-SnapshotsActionsTest-1987166464 None] Created volume successfully.
Jun 24 04:16:13 devstack sudo[98680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68
Jun 24 04:16:13 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:14 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-e2a23fe8-8f96-4b00-97bc-e22c4263fec7 req-8ec28863-6f11-48d2-8f84-de1bff7b50b3 tempest-ServerActionsTestOtherA-189006233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68" returned: 0 in 0.937s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-e2a23fe8-8f96-4b00-97bc-e22c4263fec7 req-8ec28863-6f11-48d2-8f84-de1bff7b50b3 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.428s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Creating offline snapshot 7f6a2575-fbab-4b8d-8337-40ca329e7310 of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:16:14 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c0934-36b6-44cb-beb6-519ba58e8110]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-e2a23fe8-8f96-4b00-97bc-e22c4263fec7 req-8ec28863-6f11-48d2-8f84-de1bff7b50b3 tempest-ServerActionsTestOtherA-189006233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-0f2dabf3-d555-48d6-9137-2da4897c3c68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '376f2159-9f2f-4e00-b689-7c153e81dc94', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:16:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-e2a23fe8-8f96-4b00-97bc-e22c4263fec7 req-8ec28863-6f11-48d2-8f84-de1bff7b50b3 tempest-ServerActionsTestOtherA-189006233 None] attachment_update completed successfully.
Jun 24 04:16:14 devstack sudo[98723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac
Jun 24 04:16:14 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:15 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac" returned: 0 in 0.890s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:15 devstack sudo[98749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 1G
Jun 24 04:16:15 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:16 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 1G" returned: 0 in 0.917s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:16 devstack sudo[98760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:16 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:17 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.738s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:17 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 is being set with open permissions: ugo+rw
Jun 24 04:16:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:17 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:17 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:17 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.680s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:17 devstack sudo[98771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.info
Jun 24 04:16:17 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:18 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.info" returned: 0 in 0.655s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:18 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.info is being set with open permissions: ugo+rw
Jun 24 04:16:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:18 devstack sudo[98776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.info
Jun 24 04:16:18 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:19 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.info" returned: 0 in 0.721s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.744s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:19 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-68a44267-16a0-4de8-93b7-9e9f53fad107 tempest-SnapshotsActionsTest-1987166464 None] Create snapshot completed successfully
Jun 24 04:16:20 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-36def74f-793c-49f1-8050-dde2a432db22 req-1b445d0f-7ed7-4e7f-a997-12ae4c2d6418 tempest-AttachVolumeTestJSON-1434652702 None] Terminate volume connection completed successfully.
Jun 24 04:16:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-36def74f-793c-49f1-8050-dde2a432db22 req-1b445d0f-7ed7-4e7f-a997-12ae4c2d6418 tempest-AttachVolumeTestJSON-1434652702 None] Deleting attachment a6f2602d-8771-4060-a48d-3754438f377b. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:16:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Creating offline snapshot a62c4ee6-a474-4867-84db-b6062de1715d of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:16:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61fc1eb-beae-4bb6-ada1-158636d5413e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:22 devstack sudo[98838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:22 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:23 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 1.448s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:23 devstack sudo[98887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d 1G
Jun 24 04:16:23 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:25 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-b0effce4-ebd9-4445-9dc0-773a8ec07f6c tempest-ServerActionsTestOtherA-189006233 None] Terminate volume connection completed successfully.
Jun 24 04:16:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-b0effce4-ebd9-4445-9dc0-773a8ec07f6c tempest-ServerActionsTestOtherA-189006233 None] Deleting attachment 376f2159-9f2f-4e00-b689-7c153e81dc94. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:16:25 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d 1G" returned: 0 in 1.654s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:25 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d
Jun 24 04:16:25 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Acquiring lock "cinder-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "cinder-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Acquiring lock "cinder-quobyte-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:26 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d" returned: 0 in 1.378s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:26 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d is being set with open permissions: ugo+rw
Jun 24 04:16:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "cinder-quobyte-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a" acquired by "delete_volume" :: waited 0.041s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:26 devstack sudo[99006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d
Jun 24 04:16:26 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:26 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f774d7-074e-4475-b685-f2fee94f4f6a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:26 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a
Jun 24 04:16:26 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:27 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d" returned: 0 in 0.845s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.509s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ec006d08-a9ec-4324-a638-5b341a4130ba tempest-SnapshotsActionsTest-1987166464 None] Create snapshot completed successfully
Jun 24 04:16:27 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a" returned: 0 in 1.141s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-3327fa23-50fe-4068-b459-8f7deb0ecec8 tempest-ServerActionsTestOtherA-189006233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-3327fa23-50fe-4068-b459-8f7deb0ecec8 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:27 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a
Jun 24 04:16:27 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:27 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea1c9a-75df-4afb-a2c2-b8c552bcda8d]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-3327fa23-50fe-4068-b459-8f7deb0ecec8 tempest-ServerActionsTestOtherA-189006233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:27 devstack sudo[99024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68
Jun 24 04:16:27 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:28 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a" returned: 0 in 0.711s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "cinder-quobyte-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a" released by "delete_volume" :: held 1.932s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-a62c4ee6-a474-4867-84db-b6062de1715d-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-a62c4ee6-a474-4867-84db-b6062de1715d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Created reservations ['ae4ee93b-df37-492a-8190-ed436664c6bf', '71db074e-0c70-46d9-95ed-97072ca28712', 'ef2d4827-8786-4811-88f8-e6ca2fc8e053', 'df448ed5-855c-4e8f-92ae-d374076ca04e'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-quobyte-a62c4ee6-a474-4867-84db-b6062de1715d" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-a62c4ee6-a474-4867-84db-b6062de1715d" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Deleting offline snapshot a62c4ee6-a474-4867-84db-b6062de1715d of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] snapshot_file for this snap is: volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[15903584-be99-4a6a-adb9-5cc11836267f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:28 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-3327fa23-50fe-4068-b459-8f7deb0ecec8 tempest-ServerActionsTestOtherA-189006233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68" returned: 0 in 1.023s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-3327fa23-50fe-4068-b459-8f7deb0ecec8 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.050s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-3327fa23-50fe-4068-b459-8f7deb0ecec8 tempest-ServerActionsTestOtherA-189006233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-0f2dabf3-d555-48d6-9137-2da4897c3c68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e241d6f-f213-44fb-8e73-36eb553e0738', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:28 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:16:28 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:28 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-f8e069f8-db90-4f97-a519-ce1d20d489b8 req-3327fa23-50fe-4068-b459-8f7deb0ecec8 tempest-ServerActionsTestOtherA-189006233 None] attachment_update completed successfully.
Jun 24 04:16:29 devstack sudo[99030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d
Jun 24 04:16:29 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:29 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d" returned: 0 in 0.972s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:29 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.895s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:29 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:29 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Deleted volume successfully.
Jun 24 04:16:29 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f709aa-d123-48eb-8066-07ba8f74ab07]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f59de7d9-33c7-4b83-b9d7-b6592d83f17a tempest-ServerRescueNegativeTestJSON-214601606 None] Lock "cinder-5f3c7aba-82f0-4cb3-9da8-2e4ba827d88a-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:29 devstack sudo[99039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:29 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:30 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.896s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:30 devstack sudo[99046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d
Jun 24 04:16:30 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:32 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d" returned: 0 in 1.635s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:32 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d
Jun 24 04:16:32 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:33 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.a62c4ee6-a474-4867-84db-b6062de1715d" returned: 0 in 0.972s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-a62c4ee6-a474-4867-84db-b6062de1715d" released by "_delete_snapshot" :: held 4.646s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" released by "delete_snapshot" :: held 4.715s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:33 devstack cinder-volume[93470]: WARNING cinder.quota [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:16:33 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Created reservations ['d9618f07-7925-4a94-b3ba-43441ca669c6', '667ff82f-f8c3-4f76-a381-7738bb2769ff', '7e79e4b5-b4e2-4510-b001-27de939b7f8f', '4356992c-f43c-4e2a-87c6-753ab3c1d431'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Delete snapshot completed successfully.
Jun 24 04:16:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-db581b8b-c947-4f93-ab48-08d8d2308811 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-a62c4ee6-a474-4867-84db-b6062de1715d-delete_snapshot" released by "delete_snapshot" :: held 5.074s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Creating offline snapshot 9b7182fb-2e66-4853-b928-c4bed311046a of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:16:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad9c1a5-a468-410c-8b1b-35b093d3bf88]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:34 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:34 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:35 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.966s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:35 devstack sudo[99238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a 1G
Jun 24 04:16:35 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:36 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a 1G" returned: 0 in 1.014s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:36 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a
Jun 24 04:16:36 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:38 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a" returned: 0 in 1.771s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:38 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a is being set with open permissions: ugo+rw
Jun 24 04:16:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:38 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a
Jun 24 04:16:38 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:39 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a" returned: 0 in 1.383s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.306s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:39 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6c3374b9-bf44-4459-9243-93bce09b3fd2 tempest-SnapshotsActionsTest-1987166464 None] Create snapshot completed successfully
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-9b7182fb-2e66-4853-b928-c4bed311046a-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-9b7182fb-2e66-4853-b928-c4bed311046a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" acquired by "delete_snapshot" :: waited 0.059s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-quobyte-9b7182fb-2e66-4853-b928-c4bed311046a" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-9b7182fb-2e66-4853-b928-c4bed311046a" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Deleting offline snapshot 9b7182fb-2e66-4853-b928-c4bed311046a of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] snapshot_file for this snap is: volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a09c0-8d43-474e-b13f-3a2dfde78963]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:41 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a
Jun 24 04:16:41 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:42 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a" returned: 0 in 1.578s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:43 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98c2686-447f-4a06-ae46-44e70b6c98a1]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:43 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:43 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:43 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.880s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:43 devstack sudo[99741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a
Jun 24 04:16:43 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:44 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a" returned: 0 in 0.753s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:44 devstack sudo[99746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a
Jun 24 04:16:44 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:45 devstack sudo[99749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:16:45 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:45 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.9b7182fb-2e66-4853-b928-c4bed311046a" returned: 0 in 0.711s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-9b7182fb-2e66-4853-b928-c4bed311046a" released by "_delete_snapshot" :: held 4.099s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" released by "delete_snapshot" :: held 4.166s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Created reservations ['21078e91-e6f4-419a-b13e-c6c1c1b70fe5', '5ed46d59-ebe9-459d-b8bc-714776c08e09', 'b7d9d645-5469-4ba7-943f-51cb0e5847b2', '39e73ef0-21f2-4430-9d69-d69abcdcb8a6'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Delete snapshot completed successfully.
Jun 24 04:16:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-af0f1020-ed13-4df6-810a-a63a0864bf0e tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-9b7182fb-2e66-4853-b928-c4bed311046a-delete_snapshot" released by "delete_snapshot" :: held 4.477s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:46 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.788s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Creating offline snapshot 96583c37-8dfe-40a6-a5d5-b825248e927b of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:16:47 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[47abebca-aaa2-49e7-a105-ec7e1a86c6ae]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:47 devstack sudo[99753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:47 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:48 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 1.370s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:48 devstack sudo[99760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b 1G
Jun 24 04:16:48 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:49 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b 1G" returned: 0 in 1.005s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:49 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b
Jun 24 04:16:49 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:50 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b" returned: 0 in 0.946s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:50 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b is being set with open permissions: ugo+rw
Jun 24 04:16:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:50 devstack sudo[99772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b
Jun 24 04:16:50 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:51 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b" returned: 0 in 1.112s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3f270f51-bdd4-4d4c-b0a2-b51970088acc tempest-SnapshotsActionsTest-1987166464 None] Create snapshot completed successfully
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-96583c37-8dfe-40a6-a5d5-b825248e927b-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-96583c37-8dfe-40a6-a5d5-b825248e927b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-quobyte-96583c37-8dfe-40a6-a5d5-b825248e927b" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-96583c37-8dfe-40a6-a5d5-b825248e927b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Deleting offline snapshot 96583c37-8dfe-40a6-a5d5-b825248e927b of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] snapshot_file for this snap is: volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e24bb67-f599-4337-ac21-cb70cf366e38]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:52 devstack sudo[99809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b
Jun 24 04:16:52 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:53 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b" returned: 0 in 1.084s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eed282f-f51e-4f37-900b-661fb059c856]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:54 devstack sudo[99876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:54 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:54 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.914s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:54 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b
Jun 24 04:16:54 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:55 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b" returned: 0 in 0.859s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:55 devstack sudo[99890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b
Jun 24 04:16:55 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:56 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.96583c37-8dfe-40a6-a5d5-b825248e927b" returned: 0 in 0.622s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-96583c37-8dfe-40a6-a5d5-b825248e927b" released by "_delete_snapshot" :: held 3.634s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" released by "delete_snapshot" :: held 3.670s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:56 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Created reservations ['788d695d-2132-493d-9faa-a7c48b91cd28', 'a410cbe6-ea57-4865-b7d6-5fb3d380775d', '9ff1f4b1-adf9-4c6e-ab5f-a4d3891a4455', 'cd2c7a09-b799-433c-a63f-af81ee7728f8'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Delete snapshot completed successfully.
Jun 24 04:16:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3a780e0b-1f41-4633-b61c-3e80326670a3 tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-96583c37-8dfe-40a6-a5d5-b825248e927b-delete_snapshot" released by "delete_snapshot" :: held 3.838s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Creating offline snapshot 07b87dc0-250e-4f47-9600-05a6c4af8fec of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:16:57 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[043d41c3-e73d-4bec-9bd4-57066ecc3ae3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:57 devstack sudo[99893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:16:57 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:58 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.838s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:58 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec 1G
Jun 24 04:16:58 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:59 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec 1G" returned: 0 in 0.937s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:59 devstack sudo[99904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec
Jun 24 04:16:59 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec" returned: 0 in 0.759s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:59 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec is being set with open permissions: ugo+rw
Jun 24 04:16:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:59 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:59 devstack sudo[99911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec
Jun 24 04:16:59 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:00 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec" returned: 0 in 0.738s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=39,cinder:SELECT=42,cinder:INSERT=13,cinder:DELETE=4 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:17:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=55,cinder:UPDATE=38,cinder:INSERT=6,cinder:DELETE=3 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:17:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4a8a90d4-3206-40a6-aeeb-433ed1765a6f tempest-SnapshotsActionsTest-1987166464 None] Create snapshot completed successfully
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-07b87dc0-250e-4f47-9600-05a6c4af8fec-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-07b87dc0-250e-4f47-9600-05a6c4af8fec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Acquiring lock "cinder-quobyte-07b87dc0-250e-4f47-9600-05a6c4af8fec" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-07b87dc0-250e-4f47-9600-05a6c4af8fec" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Deleting offline snapshot 07b87dc0-250e-4f47-9600-05a6c4af8fec of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] snapshot_file for this snap is: volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a81bca-8c97-4675-b76e-f6e3ff437167]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:02 devstack sudo[99919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec
Jun 24 04:17:02 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:02 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec" returned: 0 in 1.162s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:17:03 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fe9184-0ce5-4ba3-ac8c-abbe9be68672]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:03 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:17:03 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:04 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 1.007s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:17:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:04 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec
Jun 24 04:17:04 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:05 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec" returned: 0 in 1.150s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:05 devstack sudo[99981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec
Jun 24 04:17:05 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:06 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.07b87dc0-250e-4f47-9600-05a6c4af8fec" returned: 0 in 0.893s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-07b87dc0-250e-4f47-9600-05a6c4af8fec" released by "_delete_snapshot" :: held 4.395s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" released by "delete_snapshot" :: held 4.433s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-dc424670-0384-4938-8172-4a17f4b96174 req-158a6e0f-fbb9-4d37-8ed6-ff76de9ff2b6 tempest-ServerActionsTestOtherA-189006233 None] Terminate volume connection completed successfully.
Jun 24 04:17:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-dc424670-0384-4938-8172-4a17f4b96174 req-158a6e0f-fbb9-4d37-8ed6-ff76de9ff2b6 tempest-ServerActionsTestOtherA-189006233 None] Deleting attachment 6e241d6f-f213-44fb-8e73-36eb553e0738. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:17:06 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Created reservations ['5f0ed5c7-f845-47f3-986f-d40428a645e3', 'f2b51f41-7430-4466-b1bb-85b37f4401cd', '481daf1b-9eb1-4d89-b180-f8c6b8dd01e7', '347c30b1-8eb9-4363-a3e0-b3dd442c5e98'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Delete snapshot completed successfully.
Jun 24 04:17:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c0b71715-d24e-4cdd-8579-5d3c2fa859bb tempest-SnapshotsActionsTest-1984918489 None] Lock "cinder-07b87dc0-250e-4f47-9600-05a6c4af8fec-delete_snapshot" released by "delete_snapshot" :: held 4.670s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "cinder-7f6a2575-fbab-4b8d-8337-40ca329e7310-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-7f6a2575-fbab-4b8d-8337-40ca329e7310-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "cinder-quobyte-7f6a2575-fbab-4b8d-8337-40ca329e7310" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-quobyte-7f6a2575-fbab-4b8d-8337-40ca329e7310" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Deleting offline snapshot 7f6a2575-fbab-4b8d-8337-40ca329e7310 of volume 80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] snapshot_file for this snap is: volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15ed2a9-4818-4e56-8c3c-42582cce0d23]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:07 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:17:07 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:08 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.871s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:17:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a8d428-3860-4343-b27c-8c480e69a5bd]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:08 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac
Jun 24 04:17:08 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:09 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac" returned: 0 in 1.006s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:09 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:17:09 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:10 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 1.049s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:10 devstack sudo[100087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310
Jun 24 04:17:10 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:11 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac.7f6a2575-fbab-4b8d-8337-40ca329e7310" returned: 0 in 0.867s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-quobyte-7f6a2575-fbab-4b8d-8337-40ca329e7310" released by "_delete_snapshot" :: held 3.918s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" released by "delete_snapshot" :: held 3.943s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Created reservations ['70d5eb76-0835-4712-bb37-3b740afeb910', '9f3a3fab-db09-4ffb-965f-3bfaf282f466', '4279da65-ee2f-4799-9d09-58d84cd7c578', 'c9933b7a-2480-472d-abbf-c339c9598d5a'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:11 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Delete snapshot completed successfully.
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c391e6f5-74ec-44d3-8e90-729580708480 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-7f6a2575-fbab-4b8d-8337-40ca329e7310-delete_snapshot" released by "delete_snapshot" :: held 4.118s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "cinder-80d43fc3-5b43-47c7-8d01-1ae01af75dac-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-80d43fc3-5b43-47c7-8d01-1ae01af75dac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:12 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8b1659-c1a1-4f46-be4c-9e7dcddf1ebf]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:12 devstack sudo[100095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac
Jun 24 04:17:12 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:12 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac" returned: 0 in 0.942s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:13 devstack sudo[100100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac
Jun 24 04:17:13 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:13 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-80d43fc3-5b43-47c7-8d01-1ae01af75dac" returned: 0 in 0.681s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-quobyte-80d43fc3-5b43-47c7-8d01-1ae01af75dac" released by "delete_volume" :: held 1.713s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Created reservations ['9cfe08ce-c6cc-4647-ac03-07de3386f9cd', '92d38c88-bdc8-4d51-aba9-67e956bf096a', '5a628459-4f5f-4bb8-ae8a-cbccc0a746cf', '97b88ac8-1fb1-4052-9867-0d44034ec25c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:13 devstack sudo[100103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:17:13 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:14 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.720s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:14 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Deleted volume successfully.
Jun 24 04:17:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-10c2aa69-dd43-420b-b7da-ea1e5890c3f3 tempest-SnapshotsActionsTest-1987166464 None] Lock "cinder-80d43fc3-5b43-47c7-8d01-1ae01af75dac-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Acquiring lock "cinder-0f2dabf3-d555-48d6-9137-2da4897c3c68-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Lock "cinder-0f2dabf3-d555-48d6-9137-2da4897c3c68-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Acquiring lock "cinder-quobyte-0f2dabf3-d555-48d6-9137-2da4897c3c68" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Lock "cinder-quobyte-0f2dabf3-d555-48d6-9137-2da4897c3c68" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:18 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0058377c-3c3d-498a-b207-745c83ea62e7]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:18 devstack sudo[100129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68
Jun 24 04:17:18 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:19 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68" returned: 0 in 0.788s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:19 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68
Jun 24 04:17:19 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:20 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0f2dabf3-d555-48d6-9137-2da4897c3c68" returned: 0 in 0.724s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Lock "cinder-quobyte-0f2dabf3-d555-48d6-9137-2da4897c3c68" released by "delete_volume" :: held 1.567s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Created reservations ['ddb96e31-2ef6-48de-ba67-7ea91d04eb52', '67e4b136-477a-4748-b611-97caa2668f71', '0ed25a71-7112-468d-a30a-12d31b39cd2e', '5caa90c0-3187-4926-914d-60c9001176f4'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:20 devstack sudo[100137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:17:20 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:20 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Flow 'volume_create_manager' (8dc5ea3b-1377-408e-a302-8cb03deffbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79ac00d-b3ee-4f2e-9c91-a13d6cf6886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79ac00d-b3ee-4f2e-9c91-a13d6cf6886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-834482157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4c042e-da25-4a5b-9986-d99543da5b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcac0f582bc4a02bf04fbed47e58745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:21Z,use_quota=True,user_id='06a6940db8c14fb6a3ceb4719ed91fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d69a355-7cd6-4340-9933-e82849a4750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d69a355-7cd6-4340-9933-e82849a4750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfafd226-9232-4537-89e7-62d0a240462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfafd226-9232-4537-89e7-62d0a240462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4c042e-da25-4a5b-9986-d99543da5b09', 'volume_name': 'volume-4e4c042e-da25-4a5b-9986-d99543da5b09', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac7dcce-2668-4c9e-a523-ddd34b7c4938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac7dcce-2668-4c9e-a523-ddd34b7c4938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4287f1b5-5230-4aa8-9b34-b3f0f2bd455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:21 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Volume 4e4c042e-da25-4a5b-9986-d99543da5b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4c042e-da25-4a5b-9986-d99543da5b09', 'volume_size': 1}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-834482157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4c042e-da25-4a5b-9986-d99543da5b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcac0f582bc4a02bf04fbed47e58745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:21Z,use_quota=True,user_id='06a6940db8c14fb6a3ceb4719ed91fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Creating volume 4e4c042e-da25-4a5b-9986-d99543da5b09 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:21 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:21 devstack sudo[100144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09 1073741824
Jun 24 04:17:21 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:21 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.066s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Deleted volume successfully.
Jun 24 04:17:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4ad49ff-8d5f-460d-8699-a1d91e2eed09 tempest-ServerActionsTestOtherA-189006233 None] Lock "cinder-0f2dabf3-d555-48d6-9137-2da4897c3c68-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:22 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09 1073741824" returned: 0 in 1.264s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:22 devstack sudo[100190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09
Jun 24 04:17:22 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:23 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09" returned: 0 in 1.046s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] <== create_volume: return (2404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4287f1b5-5230-4aa8-9b34-b3f0f2bd455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4c042e-da25-4a5b-9986-d99543da5b09', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b398c5-faff-4977-9e3f-10ec66c44bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:23 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Volume volume-4e4c042e-da25-4a5b-9986-d99543da5b09 (4e4c042e-da25-4a5b-9986-d99543da5b09): created successfully
Jun 24 04:17:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b398c5-faff-4977-9e3f-10ec66c44bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Flow 'volume_create_manager' (8dc5ea3b-1377-408e-a302-8cb03deffbce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-49eb6076-4c28-45fe-88b5-6b95e9f738bd tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Created volume successfully.
Jun 24 04:17:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Acquiring lock "cinder-4e4c042e-da25-4a5b-9986-d99543da5b09-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "cinder-4e4c042e-da25-4a5b-9986-d99543da5b09-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Acquiring lock "cinder-quobyte-4e4c042e-da25-4a5b-9986-d99543da5b09" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "cinder-quobyte-4e4c042e-da25-4a5b-9986-d99543da5b09" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:26 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a15af-2bd7-41fc-8354-14b766e18268]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:26 devstack sudo[100316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09
Jun 24 04:17:26 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:27 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09" returned: 0 in 1.000s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:27 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09
Jun 24 04:17:27 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:27 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4e4c042e-da25-4a5b-9986-d99543da5b09" returned: 0 in 0.946s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "cinder-quobyte-4e4c042e-da25-4a5b-9986-d99543da5b09" released by "delete_volume" :: held 2.024s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:28 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Created reservations ['3e1d33b8-4c67-4a38-94c6-6f062ebc18da', 'cd54da51-34ec-4989-adac-7bee92413e3e', '06d01571-f25d-43e5-9d37-8ed53794da16', '1a1fd9d4-f374-4483-b82a-3dd756536b8a'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:28 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:17:28 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:29 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.938s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:29 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:29 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Deleted volume successfully.
Jun 24 04:17:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-921ae2ab-f94f-4442-95a7-08901d178565 tempest-VolumeQuotasNegativeTestJSON-1406766543 None] Lock "cinder-4e4c042e-da25-4a5b-9986-d99543da5b09-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:38 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=26,cinder:INSERT=11,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:17:39 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=31,cinder:UPDATE=44,cinder:DELETE=2,cinder:INSERT=10 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Flow 'volume_create_manager' (edbfb672-67db-45f1-be78-7436e37e73ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d00b511-7c15-433b-9c2d-a45004cbf8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d00b511-7c15-433b-9c2d-a45004cbf8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-177144506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3834773b-feae-4dd0-8308-e2f946b240e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808ee173e0b2490ba021f911c1a1b523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:41Z,use_quota=True,user_id='79692e84d2ea4ded97a860780e8d7d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f47883-72a5-42b1-ac66-c0382456ff26),volume_type_id=03f47883-72a5-42b1-ac66-c0382456ff26)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22df2b3-1030-4c6d-a569-75acdf37356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22df2b3-1030-4c6d-a569-75acdf37356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36aebae-bc49-4d47-a991-72735eed4414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36aebae-bc49-4d47-a991-72735eed4414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3834773b-feae-4dd0-8308-e2f946b240e2', 'volume_name': 'volume-3834773b-feae-4dd0-8308-e2f946b240e2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9590110a-c5be-4b35-bb9d-b17bf33e4b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9590110a-c5be-4b35-bb9d-b17bf33e4b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1944d83d-2d98-48be-8edb-1e65be1cdccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Volume 3834773b-feae-4dd0-8308-e2f946b240e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3834773b-feae-4dd0-8308-e2f946b240e2', 'volume_size': 1}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-177144506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3834773b-feae-4dd0-8308-e2f946b240e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808ee173e0b2490ba021f911c1a1b523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:41Z,use_quota=True,user_id='79692e84d2ea4ded97a860780e8d7d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f47883-72a5-42b1-ac66-c0382456ff26),volume_type_id=03f47883-72a5-42b1-ac66-c0382456ff26)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Creating volume 3834773b-feae-4dd0-8308-e2f946b240e2 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:40 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:17:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:40 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2 1073741824
Jun 24 04:17:40 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:41 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2 1073741824" returned: 0 in 0.917s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:41 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2
Jun 24 04:17:41 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:42 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2" returned: 0 in 0.769s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1944d83d-2d98-48be-8edb-1e65be1cdccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3834773b-feae-4dd0-8308-e2f946b240e2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a1d72b-c96b-4215-b383-2941a380dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:42 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Volume volume-3834773b-feae-4dd0-8308-e2f946b240e2 (3834773b-feae-4dd0-8308-e2f946b240e2): created successfully
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a1d72b-c96b-4215-b383-2941a380dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Flow 'volume_create_manager' (edbfb672-67db-45f1-be78-7436e37e73ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-be3f2bde-2f52-46eb-a08f-ea7dd700a63a tempest-VolumeTypesAccessTest-1957864521 None] Created volume successfully.
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Acquiring lock "cinder-3834773b-feae-4dd0-8308-e2f946b240e2-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Lock "cinder-3834773b-feae-4dd0-8308-e2f946b240e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Acquiring lock "cinder-quobyte-3834773b-feae-4dd0-8308-e2f946b240e2" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Lock "cinder-quobyte-3834773b-feae-4dd0-8308-e2f946b240e2" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b23c3-fb6b-4e11-aa8d-545a7f3742e5]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:43 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2
Jun 24 04:17:43 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:43 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2" returned: 0 in 0.861s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:43 devstack sudo[100451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2
Jun 24 04:17:43 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:44 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3834773b-feae-4dd0-8308-e2f946b240e2" returned: 0 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Lock "cinder-quobyte-3834773b-feae-4dd0-8308-e2f946b240e2" released by "delete_volume" :: held 1.673s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:44 devstack cinder-volume[93470]: WARNING cinder.quota [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-796084676 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-796084676, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:17:44 devstack cinder-volume[93470]: WARNING cinder.quota [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-796084676 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-796084676, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Created reservations ['33217652-eb8e-4bd0-9ae3-6ac6e1756925', 'b01636b2-a45c-462f-a552-b7c1628606d8', '4daefd6b-6af4-42b9-847c-e3b0d9f25fce', 'b1346af5-b450-4fc0-b86c-b9f02683fe6f'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:44 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:17:44 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:45 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:17:45 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:45 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.986s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Deleted volume successfully.
Jun 24 04:17:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0634d44-04a9-4098-9a03-bfdad505e13d tempest-VolumeTypesAccessTest-1957864521 None] Lock "cinder-3834773b-feae-4dd0-8308-e2f946b240e2-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:46 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.083s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:17:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 8 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:17:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Flow 'volume_create_manager' (7a146b1d-d7c4-404a-9495-b860ce2b63db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e9df4-ebee-44da-820c-10d39f7801f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e9df4-ebee-44da-820c-10d39f7801f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1397915012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babed51b-0de0-4728-bc44-20ac4a755347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c5e157c42e4457b5668e6fd6d9da06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:49Z,use_quota=True,user_id='d9bab27a0e034d00823549323a7beec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e6221a-e10f-4f62-aad9-6a293cac0d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e6221a-e10f-4f62-aad9-6a293cac0d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcc23dc-b280-4373-afb7-113cd2b18e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcc23dc-b280-4373-afb7-113cd2b18e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babed51b-0de0-4728-bc44-20ac4a755347', 'volume_name': 'volume-babed51b-0de0-4728-bc44-20ac4a755347', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91102065-185f-452b-ad0b-d18d693a7aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91102065-185f-452b-ad0b-d18d693a7aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef98f9e-8de2-48f7-992a-272108bb4937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Volume babed51b-0de0-4728-bc44-20ac4a755347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babed51b-0de0-4728-bc44-20ac4a755347', 'volume_size': 1}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1397915012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babed51b-0de0-4728-bc44-20ac4a755347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c5e157c42e4457b5668e6fd6d9da06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:49Z,use_quota=True,user_id='d9bab27a0e034d00823549323a7beec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Creating volume babed51b-0de0-4728-bc44-20ac4a755347 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:49 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:17:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:49 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347 1073741824
Jun 24 04:17:49 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:50 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347 1073741824" returned: 0 in 1.021s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:50 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347
Jun 24 04:17:50 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:51 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347" returned: 0 in 0.681s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef98f9e-8de2-48f7-992a-272108bb4937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babed51b-0de0-4728-bc44-20ac4a755347', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1468fb8f-7d11-4b81-a36b-5c2e40e1f03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:51 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Volume volume-babed51b-0de0-4728-bc44-20ac4a755347 (babed51b-0de0-4728-bc44-20ac4a755347): created successfully
Jun 24 04:17:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1468fb8f-7d11-4b81-a36b-5c2e40e1f03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Flow 'volume_create_manager' (7a146b1d-d7c4-404a-9495-b860ce2b63db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-503d1f09-0a68-4969-bad0-666bb6c14312 tempest-AttachVolumeShelveTestJSON-1432908922 None] Created volume successfully.
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Flow 'volume_create_manager' (4d5b853d-b424-4a4b-80f6-31df332b678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb9f819-6df4-4ab1-9de0-c7aaad26fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb9f819-6df4-4ab1-9de0-c7aaad26fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2134023689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd68261-787a-4b7f-a6bf-cbb3c4e52c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936f6acf251a40fbae06d8ffec8f8f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:59Z,use_quota=True,user_id='466d20178fff40f5a4d2a6f36983a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205cba68-78f2-4811-91ae-9a32d6c80448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205cba68-78f2-4811-91ae-9a32d6c80448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f8d390-2b46-45a5-a40c-59cfb07f63b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f8d390-2b46-45a5-a40c-59cfb07f63b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd68261-787a-4b7f-a6bf-cbb3c4e52c63', 'volume_name': 'volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1654b775-4c35-458e-b5b7-0d27464091cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1654b775-4c35-458e-b5b7-0d27464091cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff41869b-a9b0-47c5-a2a0-27d60ac027c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:58 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Volume 4bd68261-787a-4b7f-a6bf-cbb3c4e52c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63', 'volume_size': 1}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2134023689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd68261-787a-4b7f-a6bf-cbb3c4e52c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936f6acf251a40fbae06d8ffec8f8f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:59Z,use_quota=True,user_id='466d20178fff40f5a4d2a6f36983a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Creating volume 4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:58 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:17:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:58 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 1073741824
Jun 24 04:17:58 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:59 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 1073741824" returned: 0 in 1.054s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:59 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63
Jun 24 04:17:59 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:00 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63" returned: 0 in 0.965s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff41869b-a9b0-47c5-a2a0-27d60ac027c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9484404-d6cf-4a23-b82c-decc1fb628fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:00 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Volume volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 (4bd68261-787a-4b7f-a6bf-cbb3c4e52c63): created successfully
Jun 24 04:18:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9484404-d6cf-4a23-b82c-decc1fb628fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Flow 'volume_create_manager' (4d5b853d-b424-4a4b-80f6-31df332b678f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8f1f36aa-ec96-448c-8fee-f9d54086fa21 tempest-AttachVolumeTestJSON-1434652702 None] Created volume successfully.
Jun 24 04:18:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-fa34fe67-c9d1-4920-a241-bfc714e39267 req-311f403b-7634-420a-a375-576ef1418ebd tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-fa34fe67-c9d1-4920-a241-bfc714e39267 req-311f403b-7634-420a-a375-576ef1418ebd tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:05 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6463a39d-3394-490a-855d-5fec94352395]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-fa34fe67-c9d1-4920-a241-bfc714e39267 req-311f403b-7634-420a-a375-576ef1418ebd tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:05 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63
Jun 24 04:18:05 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:06 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-fa34fe67-c9d1-4920-a241-bfc714e39267 req-311f403b-7634-420a-a375-576ef1418ebd tempest-AttachVolumeTestJSON-1434652702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63" returned: 0 in 0.810s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-fa34fe67-c9d1-4920-a241-bfc714e39267 req-311f403b-7634-420a-a375-576ef1418ebd tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-fa34fe67-c9d1-4920-a241-bfc714e39267 req-311f403b-7634-420a-a375-576ef1418ebd tempest-AttachVolumeTestJSON-1434652702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c6d73dd-aa2d-40a9-9475-84ed839870bd', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:18:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-fa34fe67-c9d1-4920-a241-bfc714e39267 req-311f403b-7634-420a-a375-576ef1418ebd tempest-AttachVolumeTestJSON-1434652702 None] attachment_update completed successfully.
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Flow 'volume_create_manager' (dd1493e3-2abb-4556-ab1a-cde6ce6900fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ca4a91-e771-4b18-a2e2-93e4afdbad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ca4a91-e771-4b18-a2e2-93e4afdbad84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-847100843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6bafa8-b15e-404a-a69e-d60ee2cac4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a72b4b3ad040e4a4aa6590e8fb5d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:08Z,use_quota=True,user_id='b8f021f91fa0426ab10e70cb6b74aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a2d357-d8b2-439f-853f-dfccd49bc13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a2d357-d8b2-439f-853f-dfccd49bc13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7f5b49-11f0-479b-a4fc-ecac2df6038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7f5b49-11f0-479b-a4fc-ecac2df6038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6bafa8-b15e-404a-a69e-d60ee2cac4c1', 'volume_name': 'volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcc38b9-d8d8-4bba-b73c-6909be570887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcc38b9-d8d8-4bba-b73c-6909be570887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfdb180-3e49-4163-8669-6765a5ab31a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:07 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Volume 0b6bafa8-b15e-404a-a69e-d60ee2cac4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1', 'volume_size': 1}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-847100843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6bafa8-b15e-404a-a69e-d60ee2cac4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a72b4b3ad040e4a4aa6590e8fb5d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:08Z,use_quota=True,user_id='b8f021f91fa0426ab10e70cb6b74aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Creating volume 0b6bafa8-b15e-404a-a69e-d60ee2cac4c1 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:07 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:18:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:08 devstack sudo[101017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1 1073741824
Jun 24 04:18:08 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:09 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1 1073741824" returned: 0 in 1.141s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-ab5de8d2-e45f-4585-8e5e-2ab269f0e920 req-95f0b4d0-7c12-4ebe-ba27-b9d0679be3e1 tempest-AttachVolumeShelveTestJSON-1432908922 None] No connector for attachment 3a9097e6-fdc1-4275-b022-1c781515812f; skipping storage backend terminate_connection call. {{(pid=93470) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 24 04:18:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-ab5de8d2-e45f-4585-8e5e-2ab269f0e920 req-95f0b4d0-7c12-4ebe-ba27-b9d0679be3e1 tempest-AttachVolumeShelveTestJSON-1432908922 None] Deleting attachment 3a9097e6-fdc1-4275-b022-1c781515812f. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:18:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:09 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1
Jun 24 04:18:09 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:10 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1" returned: 0 in 0.922s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfdb180-3e49-4163-8669-6765a5ab31a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cc09a7-97a0-4357-af27-330a9ecde26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:10 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Volume volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1 (0b6bafa8-b15e-404a-a69e-d60ee2cac4c1): created successfully
Jun 24 04:18:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cc09a7-97a0-4357-af27-330a9ecde26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Flow 'volume_create_manager' (dd1493e3-2abb-4556-ab1a-cde6ce6900fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2cb9f3ae-f0ba-4d67-b45d-eb58b6a64ce0 tempest-AbsoluteLimitsTests-1288638739 None] Created volume successfully.
Jun 24 04:18:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Acquiring lock "cinder-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Lock "cinder-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Acquiring lock "cinder-quobyte-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Lock "cinder-quobyte-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:11 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ec488-2a34-4943-9b8c-828fca009b79]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:11 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1
Jun 24 04:18:11 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Flow 'volume_create_manager' (7891be7d-13c1-4e09-bf82-595a6abd51d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde728de-bea3-41a6-9689-3d7f93c018ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde728de-bea3-41a6-9689-3d7f93c018ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-560061557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68a2036-9078-4d96-b957-f46189805a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936f6acf251a40fbae06d8ffec8f8f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:12Z,use_quota=True,user_id='466d20178fff40f5a4d2a6f36983a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079b878f-b948-4b6d-9aa9-a5e762c88227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079b878f-b948-4b6d-9aa9-a5e762c88227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7940312-2f97-47cd-84db-4c973a4048e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7940312-2f97-47cd-84db-4c973a4048e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a68a2036-9078-4d96-b957-f46189805a21', 'volume_name': 'volume-a68a2036-9078-4d96-b957-f46189805a21', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c85059d-bb25-43c0-80a8-245e27740025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c85059d-bb25-43c0-80a8-245e27740025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb244a1-83f8-4b13-8806-dc314882e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:12 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Volume a68a2036-9078-4d96-b957-f46189805a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a68a2036-9078-4d96-b957-f46189805a21', 'volume_size': 1}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-560061557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68a2036-9078-4d96-b957-f46189805a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936f6acf251a40fbae06d8ffec8f8f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:12Z,use_quota=True,user_id='466d20178fff40f5a4d2a6f36983a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Creating volume a68a2036-9078-4d96-b957-f46189805a21 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:12 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:12 devstack sudo[101090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21 1073741824
Jun 24 04:18:12 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:12 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1" returned: 0 in 0.914s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:12 devstack sudo[101092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1
Jun 24 04:18:12 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:12 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1" returned: 0 in 0.713s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Lock "cinder-quobyte-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1" released by "delete_volume" :: held 1.688s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:12 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Created reservations ['d26eeeaa-7629-44bc-92b7-e64133ca01d0', 'ca53ccc3-a36d-418d-a86e-659d0398ac6b', 'f17e9e83-a5ea-4e81-9f06-a91018959fc8', '0faebd70-c91c-4d25-8b82-3609720c035d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:13 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:18:13 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:13 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21 1073741824" returned: 0 in 1.010s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:13 devstack sudo[101101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21
Jun 24 04:18:13 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:13 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.717s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:13 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Deleted volume successfully.
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6f23fd93-765d-48a6-b14d-a34f6bd79681 tempest-AbsoluteLimitsTests-1288638739 None] Lock "cinder-0b6bafa8-b15e-404a-a69e-d60ee2cac4c1-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:13 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb244a1-83f8-4b13-8806-dc314882e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68a2036-9078-4d96-b957-f46189805a21', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f970e13-e892-420b-a5a0-17c1fca99c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:13 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Volume volume-a68a2036-9078-4d96-b957-f46189805a21 (a68a2036-9078-4d96-b957-f46189805a21): created successfully
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f970e13-e892-420b-a5a0-17c1fca99c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Flow 'volume_create_manager' (7891be7d-13c1-4e09-bf82-595a6abd51d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:13 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3b54a38f-6ed1-415f-9332-712672590427 tempest-AttachVolumeTestJSON-1434652702 None] Created volume successfully.
Jun 24 04:18:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-da5d26d4-155e-462b-8b88-5b3be61b7be2 req-6687d964-bbee-4b11-9d5e-e5c50adb5f14 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-da5d26d4-155e-462b-8b88-5b3be61b7be2 req-6687d964-bbee-4b11-9d5e-e5c50adb5f14 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:17 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd928c81-d75a-4f08-8f8b-569bc9a902e6]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-da5d26d4-155e-462b-8b88-5b3be61b7be2 req-6687d964-bbee-4b11-9d5e-e5c50adb5f14 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:17 devstack sudo[101205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21
Jun 24 04:18:17 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:19 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-da5d26d4-155e-462b-8b88-5b3be61b7be2 req-6687d964-bbee-4b11-9d5e-e5c50adb5f14 tempest-AttachVolumeTestJSON-1434652702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21" returned: 0 in 1.509s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-da5d26d4-155e-462b-8b88-5b3be61b7be2 req-6687d964-bbee-4b11-9d5e-e5c50adb5f14 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.557s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-da5d26d4-155e-462b-8b88-5b3be61b7be2 req-6687d964-bbee-4b11-9d5e-e5c50adb5f14 tempest-AttachVolumeTestJSON-1434652702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-a68a2036-9078-4d96-b957-f46189805a21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28d3a701-e208-4ce3-9507-70ef3109174a', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:18:19 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-da5d26d4-155e-462b-8b88-5b3be61b7be2 req-6687d964-bbee-4b11-9d5e-e5c50adb5f14 tempest-AttachVolumeTestJSON-1434652702 None] attachment_update completed successfully.
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Flow 'volume_create_manager' (23dd59f5-104b-49f0-a8c2-1beab1c12273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85716fa-86ce-4e8f-ad22-aef760fbcbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85716fa-86ce-4e8f-ad22-aef760fbcbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-407001132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e89b2da-c741-4486-91c5-785c96a7a39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce11ec894f10469986757177adb893c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:20Z,use_quota=True,user_id='79f016290a4644d7bec4a5ad5286cd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db1dcb0-3d68-4fa6-bca8-ee9d26d8af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db1dcb0-3d68-4fa6-bca8-ee9d26d8af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbd7e2e-89a0-4d97-b6de-e6e403dac2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbd7e2e-89a0-4d97-b6de-e6e403dac2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e89b2da-c741-4486-91c5-785c96a7a39b', 'volume_name': 'volume-5e89b2da-c741-4486-91c5-785c96a7a39b', 'volume_size': 2}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dbeccf-2d98-4e64-af18-0de7ef7c5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dbeccf-2d98-4e64-af18-0de7ef7c5576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a95f86-aabf-4d9e-ac66-dac62279c0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:19 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Volume 5e89b2da-c741-4486-91c5-785c96a7a39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e89b2da-c741-4486-91c5-785c96a7a39b', 'volume_size': 2}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-407001132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e89b2da-c741-4486-91c5-785c96a7a39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce11ec894f10469986757177adb893c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:20Z,use_quota=True,user_id='79f016290a4644d7bec4a5ad5286cd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Creating volume 5e89b2da-c741-4486-91c5-785c96a7a39b {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:19 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:18:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b 2147483648 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:19 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b 2147483648
Jun 24 04:18:19 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:21 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b 2147483648" returned: 0 in 1.326s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:21 devstack sudo[101224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b
Jun 24 04:18:21 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:22 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b" returned: 0 in 0.964s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a95f86-aabf-4d9e-ac66-dac62279c0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e89b2da-c741-4486-91c5-785c96a7a39b', 'volume_size': 2}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bf1442-d6a8-4393-af34-3c9850878f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:22 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Volume volume-5e89b2da-c741-4486-91c5-785c96a7a39b (5e89b2da-c741-4486-91c5-785c96a7a39b): created successfully
Jun 24 04:18:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bf1442-d6a8-4393-af34-3c9850878f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Flow 'volume_create_manager' (23dd59f5-104b-49f0-a8c2-1beab1c12273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9d4a2b98-17a1-49a5-a8d5-ec11b8ccb30b tempest-VolumesCloneNegativeTest-1099171966 None] Created volume successfully.
Jun 24 04:18:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Acquiring lock "cinder-5e89b2da-c741-4486-91c5-785c96a7a39b-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Lock "cinder-5e89b2da-c741-4486-91c5-785c96a7a39b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Acquiring lock "cinder-quobyte-5e89b2da-c741-4486-91c5-785c96a7a39b" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Lock "cinder-quobyte-5e89b2da-c741-4486-91c5-785c96a7a39b" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:23 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[30077615-6820-4bac-a839-4a9a30fa362f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:23 devstack sudo[101229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b
Jun 24 04:18:23 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:24 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b" returned: 0 in 0.950s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:24 devstack sudo[101257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b
Jun 24 04:18:24 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:25 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5e89b2da-c741-4486-91c5-785c96a7a39b" returned: 0 in 0.840s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Lock "cinder-quobyte-5e89b2da-c741-4486-91c5-785c96a7a39b" released by "delete_volume" :: held 1.850s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Created reservations ['fb67fb1c-ea9e-4d40-a8bb-8b5f535ae52b', '31c0b86b-2dff-4d16-80f8-26f6af50b7bd', 'cf91542d-54ae-469f-b66e-57af8519a18c', 'ea5b20a9-b5e3-4098-9e19-061bd29647c6'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:25 devstack sudo[101272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:18:25 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:26 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.929s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:26 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Deleted volume successfully.
Jun 24 04:18:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e50c4b77-50ab-4f08-b17d-5a9e7504cd46 tempest-VolumesCloneNegativeTest-1099171966 None] Lock "cinder-5e89b2da-c741-4486-91c5-785c96a7a39b-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-cb394777-c1b4-49b4-b028-10b91969606a req-77218801-d8d4-4c69-9282-263c2ada26b2 tempest-AttachVolumeTestJSON-1434652702 None] Terminate volume connection completed successfully.
Jun 24 04:18:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-cb394777-c1b4-49b4-b028-10b91969606a req-77218801-d8d4-4c69-9282-263c2ada26b2 tempest-AttachVolumeTestJSON-1434652702 None] Deleting attachment 8c6d73dd-aa2d-40a9-9475-84ed839870bd. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (9a0a085e-26d6-4a08-93ac-27a837c4eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a039fc-dd49-4158-84f1-2f552654ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a039fc-dd49-4158-84f1-2f552654ea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-282824256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97759f01-b473-405a-ade6-644054a15731,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:29Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd3da03-0263-41e5-a185-6643f5c286e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd3da03-0263-41e5-a185-6643f5c286e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee4615b-46de-42ba-9ed8-db1b72c5fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee4615b-46de-42ba-9ed8-db1b72c5fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97759f01-b473-405a-ade6-644054a15731', 'volume_name': 'volume-97759f01-b473-405a-ade6-644054a15731', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d907978-5122-4a22-b61b-386ce00ff865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d907978-5122-4a22-b61b-386ce00ff865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff11b1a-d506-4ec9-b599-fc0138fbb954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:29 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Volume 97759f01-b473-405a-ade6-644054a15731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97759f01-b473-405a-ade6-644054a15731', 'volume_size': 1}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-282824256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97759f01-b473-405a-ade6-644054a15731,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:29Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Creating volume 97759f01-b473-405a-ade6-644054a15731 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:29 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:29 devstack sudo[101315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731 1073741824
Jun 24 04:18:29 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:29 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-06fe54ee-6f39-4909-8861-e8306ba58114 req-6a159581-019c-4c8c-8098-8ac987cacf45 tempest-AttachVolumeTestJSON-1434652702 None] Terminate volume connection completed successfully.
Jun 24 04:18:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-06fe54ee-6f39-4909-8861-e8306ba58114 req-6a159581-019c-4c8c-8098-8ac987cacf45 tempest-AttachVolumeTestJSON-1434652702 None] Deleting attachment 28d3a701-e208-4ce3-9507-70ef3109174a. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:18:30 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731 1073741824" returned: 0 in 0.970s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:30 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731
Jun 24 04:18:30 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:31 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731" returned: 0 in 0.745s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:31 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:31 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff11b1a-d506-4ec9-b599-fc0138fbb954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97759f01-b473-405a-ade6-644054a15731', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:31 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be7c155-faba-48ee-9580-b565df62e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:31 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Volume volume-97759f01-b473-405a-ade6-644054a15731 (97759f01-b473-405a-ade6-644054a15731): created successfully
Jun 24 04:18:31 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be7c155-faba-48ee-9580-b565df62e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:31 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (9a0a085e-26d6-4a08-93ac-27a837c4eb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:31 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-481dbe1d-40c5-498e-a8b8-168b52270b49 tempest-VolumesGetTest-1886308107 None] Created volume successfully.
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (82a267bd-56da-4aee-ba19-3780b6909304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2006dbc6-55b9-4bb7-be73-4f9438c0dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2006dbc6-55b9-4bb7-be73-4f9438c0dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-440088044',display_name='tempest-VolumesGetTest-Volume-1085326794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585cc3ec-6f4f-4a90-bfc1-870b5a7c6455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:33Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a6d42c-e0ef-49d3-b6a0-b12783932a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a6d42c-e0ef-49d3-b6a0-b12783932a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a914a23d-5e28-425a-abb5-86c3c60e76b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a914a23d-5e28-425a-abb5-86c3c60e76b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585cc3ec-6f4f-4a90-bfc1-870b5a7c6455', 'volume_name': 'volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32be7a79-8939-426e-ac7a-4989464ce6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32be7a79-8939-426e-ac7a-4989464ce6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cd9c3a-90d9-495d-b720-cb35d16a0e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:32 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Volume 585cc3ec-6f4f-4a90-bfc1-870b5a7c6455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455', 'volume_size': 1}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-440088044',display_name='tempest-VolumesGetTest-Volume-1085326794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585cc3ec-6f4f-4a90-bfc1-870b5a7c6455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:33Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Creating volume 585cc3ec-6f4f-4a90-bfc1-870b5a7c6455 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:32 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:18:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:32 devstack sudo[101428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455 1073741824
Jun 24 04:18:32 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:34 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455 1073741824" returned: 0 in 1.303s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:34 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455
Jun 24 04:18:34 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:35 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455" returned: 0 in 0.885s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cd9c3a-90d9-495d-b720-cb35d16a0e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbf6963-0cf3-408a-a44e-33c5adfe5f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:35 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Volume volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455 (585cc3ec-6f4f-4a90-bfc1-870b5a7c6455): created successfully
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbf6963-0cf3-408a-a44e-33c5adfe5f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (82a267bd-56da-4aee-ba19-3780b6909304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:35 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-bc027758-49f0-4905-99da-87acc65a5eee tempest-VolumesGetTest-1886308107 None] Created volume successfully.
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Lock "cinder-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:36 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8d4981-e4e9-422a-aa77-9a7b45a16387]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:36 devstack sudo[101483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455
Jun 24 04:18:36 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:36 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455" returned: 0 in 0.841s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:36 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455
Jun 24 04:18:36 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:37 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455" returned: 0 in 0.682s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455" released by "delete_volume" :: held 1.576s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Created reservations ['10c87588-9ab5-4cfc-910f-38876cf62559', '0ecb9d84-eed4-454b-81e8-da2eb77d4d48', 'f2e985dd-8ce8-4b82-8d0f-26aa37d5fc23', 'd7985481-9716-4fe9-9081-23e4b02af4f1'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:37 devstack sudo[101492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:18:37 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-97759f01-b473-405a-ade6-644054a15731-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Lock "cinder-97759f01-b473-405a-ade6-644054a15731-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=53,cinder:UPDATE=58,cinder:DELETE=6,cinder:INSERT=11 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-97759f01-b473-405a-ade6-644054a15731" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-97759f01-b473-405a-ade6-644054a15731" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cf17c5-7c4d-4388-b468-74af5ff34870]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:38 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.814s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Deleted volume successfully.
Jun 24 04:18:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e9e4c960-5909-4502-8e2b-804d8de6bfaf tempest-VolumesGetTest-1886308107 None] Lock "cinder-585cc3ec-6f4f-4a90-bfc1-870b5a7c6455-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:38 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731
Jun 24 04:18:38 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:39 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731" returned: 0 in 0.837s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:39 devstack sudo[101500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731
Jun 24 04:18:39 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:40 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97759f01-b473-405a-ade6-644054a15731" returned: 0 in 0.645s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-97759f01-b473-405a-ade6-644054a15731" released by "delete_volume" :: held 1.528s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=62,cinder:SELECT=51,cinder:INSERT=13,cinder:DELETE=6 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Created reservations ['ee249756-6233-44cc-ac40-44f72372013c', 'ab12659e-1861-42b7-b465-5e71fa8a31e1', 'a5794819-8246-4f56-a2dd-d41bb78ac055', '7d7fa026-8423-4407-9374-b735831b7218'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:40 devstack sudo[101503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:18:40 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:41 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.013s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:41 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Deleted volume successfully.
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4671d1da-a142-473a-b853-33504b8b243c tempest-VolumesGetTest-1886308107 None] Lock "cinder-97759f01-b473-405a-ade6-644054a15731-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "cinder-a68a2036-9078-4d96-b957-f46189805a21-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-a68a2036-9078-4d96-b957-f46189805a21-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "cinder-quobyte-a68a2036-9078-4d96-b957-f46189805a21" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-quobyte-a68a2036-9078-4d96-b957-f46189805a21" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf470e16-c2e6-4993-a532-b7f68043557a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:41 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21
Jun 24 04:18:41 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (62a41ce2-8f74-40fa-bc84-049d2f685ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fd030e-ff2f-41fc-a2f2-65633bf0b3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:41 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fd030e-ff2f-41fc-a2f2-65633bf0b3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-899354547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbca317-ef9e-4fdd-accf-b171eb304841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:42Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd380f4-f19b-41c0-8b27-92e332c37289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd380f4-f19b-41c0-8b27-92e332c37289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9782efc-d3be-443a-957f-df485cf2ec10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9782efc-d3be-443a-957f-df485cf2ec10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcbca317-ef9e-4fdd-accf-b171eb304841', 'volume_name': 'volume-dcbca317-ef9e-4fdd-accf-b171eb304841', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e96e06-020e-48de-8858-ed79c0da049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e96e06-020e-48de-8858-ed79c0da049a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19668e67-95cc-40bb-8d4a-b3d29517f5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Volume dcbca317-ef9e-4fdd-accf-b171eb304841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcbca317-ef9e-4fdd-accf-b171eb304841', 'volume_size': 1}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-899354547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbca317-ef9e-4fdd-accf-b171eb304841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:42Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Creating volume dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:42 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:42 devstack sudo[101512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 1073741824
Jun 24 04:18:42 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Flow 'volume_create_manager' (f7891108-87ad-44ef-a6af-695fb6cb8d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db55860-dbcb-47e7-ace2-4aacdec7f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db55860-dbcb-47e7-ace2-4aacdec7f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-132851529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdb39b7-4934-4660-b043-80d2b255a496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58cd96d582a47dcbf9b6a13c23af7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:42Z,use_quota=True,user_id='3881077525d34140a5874ee54ad6c2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b177ee-56bb-4a02-9fda-b162e99132d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b177ee-56bb-4a02-9fda-b162e99132d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68db45be-8520-4977-859d-a7beff263764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68db45be-8520-4977-859d-a7beff263764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdb39b7-4934-4660-b043-80d2b255a496', 'volume_name': 'volume-8bdb39b7-4934-4660-b043-80d2b255a496', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445215f3-e4c7-4c67-8db9-48b3f64c7ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445215f3-e4c7-4c67-8db9-48b3f64c7ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd8b0b5-eb12-4129-8623-14679e0254e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:42 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Volume 8bdb39b7-4934-4660-b043-80d2b255a496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdb39b7-4934-4660-b043-80d2b255a496', 'volume_size': 1}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:42 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21" returned: 0 in 0.868s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:42 devstack sudo[101517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21
Jun 24 04:18:42 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:42 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 1073741824" returned: 0 in 0.925s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:43 devstack sudo[101522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841
Jun 24 04:18:43 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:43 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a68a2036-9078-4d96-b957-f46189805a21" returned: 0 in 0.688s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-quobyte-a68a2036-9078-4d96-b957-f46189805a21" released by "delete_volume" :: held 1.603s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Created reservations ['9e06a42b-6022-4099-9359-b84f216ccb2c', '7bed4813-b34b-452f-9b8b-dc444f01c419', '5a08edea-4f5b-4303-bdbb-c867dd0c64c3', '114b5e7a-e494-41f7-9f30-c4d2d5f83a7a'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:43 devstack sudo[101525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:18:43 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:43 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841" returned: 0 in 0.704s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-132851529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdb39b7-4934-4660-b043-80d2b255a496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58cd96d582a47dcbf9b6a13c23af7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:42Z,use_quota=True,user_id='3881077525d34140a5874ee54ad6c2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Creating volume 8bdb39b7-4934-4660-b043-80d2b255a496 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:43 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19668e67-95cc-40bb-8d4a-b3d29517f5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcbca317-ef9e-4fdd-accf-b171eb304841', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:43 devstack sudo[101528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496 1073741824
Jun 24 04:18:43 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc974bb7-b706-416b-a875-88c436ac79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:43 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Volume volume-dcbca317-ef9e-4fdd-accf-b171eb304841 (dcbca317-ef9e-4fdd-accf-b171eb304841): created successfully
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc974bb7-b706-416b-a875-88c436ac79a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (62a41ce2-8f74-40fa-bc84-049d2f685ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b8a6dd56-f60f-429a-917a-23f83ab7ad27 tempest-VolumesGetTest-1886308107 None] Created volume successfully.
Jun 24 04:18:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "cinder-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "cinder-quobyte-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-quobyte-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8374bf6-8d5a-49bf-919a-a2bdee08679e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:44 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.734s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:44 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Deleted volume successfully.
Jun 24 04:18:44 devstack sudo[101531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63
Jun 24 04:18:44 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d35e32f0-c63f-4c94-bdf8-4cb40f687589 tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-a68a2036-9078-4d96-b957-f46189805a21-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:44 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496 1073741824" returned: 0 in 1.092s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:44 devstack sudo[101540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496
Jun 24 04:18:44 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:45 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63" returned: 0 in 0.998s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:45 devstack sudo[101545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63
Jun 24 04:18:45 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:45 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:18:45 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (a9ea402c-5f8e-45b3-826d-8966482f342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c009bee8-db35-40c9-9e4d-84bd9d6548e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c009bee8-db35-40c9-9e4d-84bd9d6548e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-4178819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d3d6e7-0e26-4617-b377-b0f8223a21a3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=dcbca317-ef9e-4fdd-accf-b171eb304841,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:45Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc54fd68-4b0e-4e88-9e81-4fcb68be1373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc54fd68-4b0e-4e88-9e81-4fcb68be1373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b699667-4f98-47a4-85b5-07012a4b426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b699667-4f98-47a4-85b5-07012a4b426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '01d3d6e7-0e26-4617-b377-b0f8223a21a3', 'volume_name': 'volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3', 'volume_size': 1, 'source_volid': 'dcbca317-ef9e-4fdd-accf-b171eb304841', 'source_volstatus': 'available'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b50f80-a8af-403a-b094-e0252923693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b50f80-a8af-403a-b094-e0252923693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1657f2-a36c-4e8e-a7ec-5f44f7ac223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Volume 01d3d6e7-0e26-4617-b377-b0f8223a21a3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3', 'volume_size': 1, 'source_volid': 'dcbca317-ef9e-4fdd-accf-b171eb304841', 'source_volstatus': 'available'}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:45 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496" returned: 0 in 0.735s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.199s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:45 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Cloning volume dcbca317-ef9e-4fdd-accf-b171eb304841 to volume 01d3d6e7-0e26-4617-b377-b0f8223a21a3
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd8b0b5-eb12-4129-8623-14679e0254e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdb39b7-4934-4660-b043-80d2b255a496', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cf46bc-2266-4f7b-b5fc-e366ac29374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Volume volume-8bdb39b7-4934-4660-b043-80d2b255a496 (8bdb39b7-4934-4660-b043-80d2b255a496): created successfully
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cf46bc-2266-4f7b-b5fc-e366ac29374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Flow 'volume_create_manager' (f7891108-87ad-44ef-a6af-695fb6cb8d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Creating offline snapshot 19c3e09f-2835-4861-904e-bbaaabd0cdc6 of volume dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:18:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ccdcf5cd-1f8f-4aac-8a9d-089cb86a0056 tempest-AttachVolumeNegativeTest-596704228 None] Created volume successfully.
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6bae6f-f027-44ce-b501-0510cf19f930]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:45 devstack sudo[101551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841
Jun 24 04:18:45 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:45 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63" returned: 0 in 0.730s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-quobyte-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63" released by "delete_volume" :: held 1.796s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:45 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Created reservations ['a850c99d-58c2-45c7-b221-cc2b0e0d0722', '3bbb1f93-9e31-4c0c-b09b-6c42faea449a', '46830653-c0db-4100-ad64-ad6c7898ba4a', 'd66b599c-2dae-40ba-96f2-9425118dab30'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:46 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.770s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 8 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:46 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:18:46 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "cinder-68a88815-f835-4ec6-8f66-c4447bcf2df8-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-68a88815-f835-4ec6-8f66-c4447bcf2df8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "cinder-quobyte-68a88815-f835-4ec6-8f66-c4447bcf2df8" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-quobyte-68a88815-f835-4ec6-8f66-c4447bcf2df8" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e480f-dbf4-484e-b5e2-decabbeefa69]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:46 devstack sudo[101563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8
Jun 24 04:18:46 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:46 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841" returned: 0 in 0.937s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:46 devstack sudo[101567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 1G
Jun 24 04:18:46 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:46 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.698s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Deleted volume successfully.
Jun 24 04:18:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2b3c204b-0713-43da-8856-8dfff352e00f tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-4bd68261-787a-4b7f-a6bf-cbb3c4e52c63-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:47 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8" returned: 0 in 0.811s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:47 devstack sudo[101575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8
Jun 24 04:18:47 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:47 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 1G" returned: 0 in 0.806s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcbca317-ef9e-4fdd-accf-b171eb304841 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:47 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcbca317-ef9e-4fdd-accf-b171eb304841 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6
Jun 24 04:18:47 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:47 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-68a88815-f835-4ec6-8f66-c4447bcf2df8" returned: 0 in 0.649s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-quobyte-68a88815-f835-4ec6-8f66-c4447bcf2df8" released by "delete_volume" :: held 1.502s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Created reservations ['d1632e38-bbb4-497e-a024-5d4e4e2a5b3f', '4c950334-3eb6-472a-ba94-0e22006db4a7', 'ddbe901e-4a8d-4892-abd7-f601186e987a', '4df43616-0b4f-49a8-be24-610f0cfe27c3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:48 devstack sudo[101584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:18:48 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:48 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcbca317-ef9e-4fdd-accf-b171eb304841 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6" returned: 0 in 0.703s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:48 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 is being set with open permissions: ugo+rw
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:48 devstack sudo[101586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6
Jun 24 04:18:48 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:48 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.774s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:48 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Deleted volume successfully.
Jun 24 04:18:48 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6" returned: 0 in 0.728s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-53c3d9ca-b6a9-409a-8c67-dd01b041e295 tempest-AttachVolumeTestJSON-1434652702 None] Lock "cinder-68a88815-f835-4ec6-8f66-c4447bcf2df8-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:48 devstack sudo[101591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.info
Jun 24 04:18:48 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-36494d9d-7bb6-4e77-a492-53ea3b5c0737 req-6d5b45d0-6426-48b4-a93d-24013bb137d2 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:49 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.info" returned: 0 in 0.691s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:49 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.info is being set with open permissions: ugo+rw
Jun 24 04:18:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:49 devstack sudo[101602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.info
Jun 24 04:18:49 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:50 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.info" returned: 0 in 0.672s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-01d3d6e7-0e26-4617-b377-b0f8223a21a3" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-01d3d6e7-0e26-4617-b377-b0f8223a21a3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] snapshot: 19c3e09f-2835-4861-904e-bbaaabd0cdc6, volume: 01d3d6e7-0e26-4617-b377-b0f8223a21a3,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b95eb1f-68de-4023-957e-41d32ad7a497]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:50 devstack sudo[101605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6
Jun 24 04:18:50 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:51 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6" returned: 0 in 0.829s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcbca317-ef9e-4fdd-accf-b171eb304841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:18:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:18:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:18:51 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[365cddf0-1fdf-4865-8ee9-1d1cffe5d610]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:51 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841
Jun 24 04:18:51 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:52 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841" returned: 0 in 1.013s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:52 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3 not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:18:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:52 devstack sudo[101618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3
Jun 24 04:18:52 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:59 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3" returned: 0 in 6.858s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:59 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dea3280-7975-48e7-9edf-75e57b12fce9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:59 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=3 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:18:59 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:INSERT=11,cinder:UPDATE=37,cinder:SELECT=32,cinder:DELETE=3 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:18:59 devstack sudo[101714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841
Jun 24 04:18:59 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-583621d5-dbb4-4e54-8468-29a09f4e5f54 tempest-GroupSnapshotsTest-2145445898 None] Group tempest-GroupSnapshotsTest-Group-308700054: creating
Jun 24 04:19:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-583621d5-dbb4-4e54-8468-29a09f4e5f54 tempest-GroupSnapshotsTest-2145445898 None] Group tempest-GroupSnapshotsTest-Group-308700054: created successfully
Jun 24 04:19:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-583621d5-dbb4-4e54-8468-29a09f4e5f54 tempest-GroupSnapshotsTest-2145445898 None] Create group completed successfully.
Jun 24 04:19:00 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841" returned: 0 in 1.086s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:19:00 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Converted 1024.00 MB image at 149.28 MB/s
Jun 24 04:19:00 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3 is being set with open permissions: ugo+rw
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:00 devstack sudo[101721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3
Jun 24 04:19:00 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:00 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3" returned: 0 in 0.636s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-01d3d6e7-0e26-4617-b377-b0f8223a21a3" released by "_copy_volume_from_snapshot" :: held 10.507s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-19c3e09f-2835-4861-904e-bbaaabd0cdc6" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-19c3e09f-2835-4861-904e-bbaaabd0cdc6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Deleting offline snapshot 19c3e09f-2835-4861-904e-bbaaabd0cdc6 of volume dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] snapshot_file for this snap is: volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed41ac35-cce9-4f96-85f5-20b02ee6ad89]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:01 devstack sudo[101724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6
Jun 24 04:19:01 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:01 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6" returned: 0 in 0.819s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcbca317-ef9e-4fdd-accf-b171eb304841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2265606-60ed-4d5a-812d-03ea463addc1]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Flow 'volume_create_manager' (f2788299-ca99-457c-a5aa-27dd2a467d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c455b41-e286-431c-a81b-a6fa773c006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c455b41-e286-431c-a81b-a6fa773c006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-879636144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41d21c2d-dbe7-46ea-bfd1-dcebf5c48bdd,host='devstack@QuobyteHD#QuobyteHD',id=905e08b1-9cc0-4ec5-b35c-be1ea2cb6928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41720268fe5b4fe7b95cc95286e53e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:02Z,use_quota=True,user_id='3e326f630bf440a5beba7136794f182a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae121a43-1548-4e46-8a1e-ddccfc53741b),volume_type_id=ae121a43-1548-4e46-8a1e-ddccfc53741b)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ed8dba-4182-4e82-b1e4-0c2ff612d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ed8dba-4182-4e82-b1e4-0c2ff612d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0f8793-3717-4549-818a-435355e409df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0f8793-3717-4549-818a-435355e409df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905e08b1-9cc0-4ec5-b35c-be1ea2cb6928', 'volume_name': 'volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a52d6a-d3d4-41db-b998-55529edbe3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a52d6a-d3d4-41db-b998-55529edbe3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e1c714-157a-46fd-9882-f189027795f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:01 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Volume 905e08b1-9cc0-4ec5-b35c-be1ea2cb6928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928', 'volume_size': 1}
Jun 24 04:19:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:01 devstack sudo[101731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841
Jun 24 04:19:01 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:02 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841" returned: 0 in 0.787s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:02 devstack sudo[101737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6
Jun 24 04:19:02 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:03 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6" returned: 0 in 0.719s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:03 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6
Jun 24 04:19:03 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:03 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841.19c3e09f-2835-4861-904e-bbaaabd0cdc6" returned: 0 in 0.698s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-19c3e09f-2835-4861-904e-bbaaabd0cdc6" released by "_delete_snapshot" :: held 3.140s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.439s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-36494d9d-7bb6-4e77-a492-53ea3b5c0737 req-6d5b45d0-6426-48b4-a93d-24013bb137d2 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.877s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1657f2-a36c-4e8e-a7ec-5f44f7ac223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3', 'volume_size': 1, 'source_volid': 'dcbca317-ef9e-4fdd-accf-b171eb304841', 'source_volstatus': 'available'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f29cbfa-742b-46de-9b51-000f4b591a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af111a-6391-467f-b33c-4723f1120c86]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-36494d9d-7bb6-4e77-a492-53ea3b5c0737 req-6d5b45d0-6426-48b4-a93d-24013bb137d2 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:04 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Volume volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3 (01d3d6e7-0e26-4617-b377-b0f8223a21a3): created successfully
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f29cbfa-742b-46de-9b51-000f4b591a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (a9ea402c-5f8e-45b3-826d-8966482f342a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d3ebf90c-08a4-4817-9af6-d9cace8d437c tempest-VolumesGetTest-1886308107 None] Created volume successfully.
Jun 24 04:19:04 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496
Jun 24 04:19:04 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Acquiring lock "cinder-babed51b-0de0-4728-bc44-20ac4a755347-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "cinder-babed51b-0de0-4728-bc44-20ac4a755347-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Acquiring lock "cinder-quobyte-babed51b-0de0-4728-bc44-20ac4a755347" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "cinder-quobyte-babed51b-0de0-4728-bc44-20ac4a755347" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f670b4f-406f-4b72-a491-ce64d59d94db]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:04 devstack sudo[101748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347
Jun 24 04:19:04 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:04 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-36494d9d-7bb6-4e77-a492-53ea3b5c0737 req-6d5b45d0-6426-48b4-a93d-24013bb137d2 tempest-AttachVolumeNegativeTest-596704228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496" returned: 0 in 0.819s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-36494d9d-7bb6-4e77-a492-53ea3b5c0737 req-6d5b45d0-6426-48b4-a93d-24013bb137d2 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=41d21c2d-dbe7-46ea-bfd1-dcebf5c48bdd,created_at=2026-06-24T02:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-879636144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41d21c2d-dbe7-46ea-bfd1-dcebf5c48bdd,host='devstack@QuobyteHD#QuobyteHD',id=905e08b1-9cc0-4ec5-b35c-be1ea2cb6928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41720268fe5b4fe7b95cc95286e53e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:02Z,use_quota=True,user_id='3e326f630bf440a5beba7136794f182a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae121a43-1548-4e46-8a1e-ddccfc53741b),volume_type_id=ae121a43-1548-4e46-8a1e-ddccfc53741b)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Creating volume 905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:04 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:04 devstack sudo[101753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 1073741824
Jun 24 04:19:04 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-36494d9d-7bb6-4e77-a492-53ea3b5c0737 req-6d5b45d0-6426-48b4-a93d-24013bb137d2 tempest-AttachVolumeNegativeTest-596704228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-8bdb39b7-4934-4660-b043-80d2b255a496', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e8883b3-8ada-4284-90db-963b1a7c565a', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:19:05 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-36494d9d-7bb6-4e77-a492-53ea3b5c0737 req-6d5b45d0-6426-48b4-a93d-24013bb137d2 tempest-AttachVolumeNegativeTest-596704228 None] attachment_update completed successfully.
Jun 24 04:19:05 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347" returned: 0 in 0.977s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:05 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347
Jun 24 04:19:05 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (9a4cc2b6-e367-4477-92c8-e97eee32d754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cd557f-72a6-4c9c-86b0-70db77e814ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cd557f-72a6-4c9c-86b0-70db77e814ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-87327494',display_name='tempest-VolumesGetTest-Volume-1615570696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4419177b-6add-402a-9a93-f8b52e9c7113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:06Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eab9c2f-3660-4e5e-aea9-b091165d69ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eab9c2f-3660-4e5e-aea9-b091165d69ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2baadb9-60b7-46ab-bdd3-4740f50772d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2baadb9-60b7-46ab-bdd3-4740f50772d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4419177b-6add-402a-9a93-f8b52e9c7113', 'volume_name': 'volume-4419177b-6add-402a-9a93-f8b52e9c7113', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8fb053-5e97-48dc-ab52-6517ab7348aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8fb053-5e97-48dc-ab52-6517ab7348aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27bbabc-891a-4a73-bcb6-df624f10c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:05 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:05 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Volume 4419177b-6add-402a-9a93-f8b52e9c7113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4419177b-6add-402a-9a93-f8b52e9c7113', 'volume_size': 1}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 1073741824" returned: 0 in 1.050s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:06 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928
Jun 24 04:19:06 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:06 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-babed51b-0de0-4728-bc44-20ac4a755347" returned: 0 in 0.708s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "cinder-quobyte-babed51b-0de0-4728-bc44-20ac4a755347" released by "delete_volume" :: held 1.732s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Created reservations ['ba9653a6-0b9f-4b91-b19d-1da200bf4cec', 'a2db9929-6dbc-41fc-a205-2e95d3762838', 'abd285e0-e4da-47c7-883c-181331b0d3be', '2c237aee-9725-40b6-97c9-804c9f5ea7de'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:06 devstack sudo[102155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:06 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:06 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" returned: 0 in 0.742s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-87327494',display_name='tempest-VolumesGetTest-Volume-1615570696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4419177b-6add-402a-9a93-f8b52e9c7113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:06Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Creating volume 4419177b-6add-402a-9a93-f8b52e9c7113 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:06 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:06 devstack sudo[102158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113 1073741824
Jun 24 04:19:06 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e1c714-157a-46fd-9882-f189027795f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4363290b-028f-4a23-8289-d1bfe34b9301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:06 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Volume volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 (905e08b1-9cc0-4ec5-b35c-be1ea2cb6928): created successfully
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4363290b-028f-4a23-8289-d1bfe34b9301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Flow 'volume_create_manager' (f2788299-ca99-457c-a5aa-27dd2a467d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6a337910-74d6-484d-89f2-601cf9389399 tempest-GroupSnapshotsTest-2145445898 None] Created volume successfully.
Jun 24 04:19:07 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.745s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:07 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:07 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Deleted volume successfully.
Jun 24 04:19:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-edb5ac68-93a9-44f8-bf28-ee9ae6741b16 tempest-AttachVolumeShelveTestJSON-1432908922 None] Lock "cinder-babed51b-0de0-4728-bc44-20ac4a755347-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:07 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113 1073741824" returned: 0 in 0.900s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:07 devstack sudo[102165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113
Jun 24 04:19:07 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] GroupSnapshot cf960271-3665-465e-8e51-da4869b0a42e: creating.
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Group snapshot cf960271-3665-465e-8e51-da4869b0a42e: creating. {{(pid=93470) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:08 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113" returned: 0 in 0.721s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.227s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27bbabc-891a-4a73-bcb6-df624f10c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4419177b-6add-402a-9a93-f8b52e9c7113', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884d4ace-661f-416b-9f5e-41019c0a889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Creating offline snapshot a49d54c4-b003-45b2-9251-ea039677fd99 of volume 905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:19:08 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Volume volume-4419177b-6add-402a-9a93-f8b52e9c7113 (4419177b-6add-402a-9a93-f8b52e9c7113): created successfully
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884d4ace-661f-416b-9f5e-41019c0a889c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (9a4cc2b6-e367-4477-92c8-e97eee32d754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47e2f13-6758-4f50-8a4b-9a88a8ab93fe]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-28b32fee-2071-40b8-ab77-993cbf8d84bf tempest-VolumesGetTest-1886308107 None] Created volume successfully.
Jun 24 04:19:08 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928
Jun 24 04:19:08 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-4419177b-6add-402a-9a93-f8b52e9c7113-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Lock "cinder-4419177b-6add-402a-9a93-f8b52e9c7113-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-4419177b-6add-402a-9a93-f8b52e9c7113" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-4419177b-6add-402a-9a93-f8b52e9c7113" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:09 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" returned: 0 in 0.880s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:09 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ff122-6795-4cf0-a5f4-8d86cc89974a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:09 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 1G
Jun 24 04:19:09 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:09 devstack sudo[102175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113
Jun 24 04:19:09 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:10 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113" returned: 0 in 1.131s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:10 devstack sudo[102221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113
Jun 24 04:19:10 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:10 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 1G" returned: 0 in 1.204s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:10 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99
Jun 24 04:19:10 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:11 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99" returned: 0 in 1.036s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:11 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:11 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4419177b-6add-402a-9a93-f8b52e9c7113" returned: 0 in 1.105s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:11 devstack sudo[102231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99
Jun 24 04:19:11 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-4419177b-6add-402a-9a93-f8b52e9c7113" released by "delete_volume" :: held 2.333s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Created reservations ['b7085d23-eacd-440c-85db-35c54cfa7a90', '19ce77b4-051b-4595-9442-0f0b8cd21489', '6e2c669a-9b7f-488c-88fb-748c40db4741', '65476cf0-7c2e-4833-aa1b-66978bf6efe0'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:11 devstack sudo[102233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:11 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:12 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99" returned: 0 in 0.840s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:12 devstack sudo[102236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.info
Jun 24 04:19:12 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:12 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.825s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:12 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Deleted volume successfully.
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-884ef1e7-3350-4390-a24c-da00ebbbd807 tempest-VolumesGetTest-1886308107 None] Lock "cinder-4419177b-6add-402a-9a93-f8b52e9c7113-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-01d3d6e7-0e26-4617-b377-b0f8223a21a3-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Lock "cinder-01d3d6e7-0e26-4617-b377-b0f8223a21a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-01d3d6e7-0e26-4617-b377-b0f8223a21a3" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-01d3d6e7-0e26-4617-b377-b0f8223a21a3" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeffe7e-1ec2-4ab2-8614-bc230ce396db]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:13 devstack sudo[102239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3
Jun 24 04:19:13 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:13 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.info" returned: 0 in 0.878s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:13 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:19:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:13 devstack sudo[102242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.info
Jun 24 04:19:13 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:13 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3" returned: 0 in 0.916s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:13 devstack sudo[102248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3
Jun 24 04:19:13 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:14 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.info" returned: 0 in 0.798s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.804s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ce0765f4-0f03-4256-87b2-a940993fd147 tempest-GroupSnapshotsTest-2145445898 None] group_snapshot cf960271-3665-465e-8e51-da4869b0a42e: created successfully
Jun 24 04:19:14 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-01d3d6e7-0e26-4617-b377-b0f8223a21a3" returned: 0 in 0.785s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-01d3d6e7-0e26-4617-b377-b0f8223a21a3" released by "delete_volume" :: held 1.759s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Created reservations ['52ba4c58-20d4-433b-90fa-fc827be7bb03', '8f952b47-4648-416a-abf6-07067861f27a', '14a8812b-6435-4103-82e5-c9427ea19bfb', '0b35d0e0-1f6b-49aa-8569-dd4c33581ddd'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:14 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:14 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Flow 'volume_create_manager' (ccf90c9a-9b0a-4e32-8ba3-e72274b5290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160618bf-a291-4840-886c-aa808a280f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160618bf-a291-4840-886c-aa808a280f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1346785692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a65e90-e826-4cec-9265-79c63a59abdd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d3d79d1034ed40fcb18fc8cfcb8cb61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:15Z,use_quota=True,user_id='f18b6f06aa114d5a94c89377da3d0d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75c9b72-c086-4ff4-9ee9-7c64d10795d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75c9b72-c086-4ff4-9ee9-7c64d10795d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091afab2-6997-49e1-91c4-c5c483e5e7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091afab2-6997-49e1-91c4-c5c483e5e7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a65e90-e826-4cec-9265-79c63a59abdd', 'volume_name': 'volume-e6a65e90-e826-4cec-9265-79c63a59abdd', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbad4fa9-e61f-4b82-a004-8c52191bdf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbad4fa9-e61f-4b82-a004-8c52191bdf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80111e8-6671-4223-b1dc-73e2b9be6e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:15 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Volume e6a65e90-e826-4cec-9265-79c63a59abdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a65e90-e826-4cec-9265-79c63a59abdd', 'volume_size': 1}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1346785692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a65e90-e826-4cec-9265-79c63a59abdd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d3d79d1034ed40fcb18fc8cfcb8cb61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:15Z,use_quota=True,user_id='f18b6f06aa114d5a94c89377da3d0d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Creating volume e6a65e90-e826-4cec-9265-79c63a59abdd {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:15 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-dcbca317-ef9e-4fdd-accf-b171eb304841-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:15 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd 1073741824
Jun 24 04:19:15 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Lock "cinder-dcbca317-ef9e-4fdd-accf-b171eb304841-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-dcbca317-ef9e-4fdd-accf-b171eb304841" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-dcbca317-ef9e-4fdd-accf-b171eb304841" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb373ed9-02e4-4ff9-90ac-5d73af693344]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:15 devstack sudo[102260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841
Jun 24 04:19:15 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:15 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.879s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:15 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Deleted volume successfully.
Jun 24 04:19:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2fe88fa9-bc8e-40d8-9ff0-13af08b1c5e8 tempest-VolumesGetTest-1886308107 None] Lock "cinder-01d3d6e7-0e26-4617-b377-b0f8223a21a3-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:16 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd 1073741824" returned: 0 in 1.061s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:16 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841" returned: 0 in 0.964s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:16 devstack sudo[102270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd
Jun 24 04:19:16 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:16 devstack sudo[102271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841
Jun 24 04:19:16 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:17 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd" returned: 0 in 0.699s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:17 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.017s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-a49d54c4-b003-45b2-9251-ea039677fd99-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dcbca317-ef9e-4fdd-accf-b171eb304841" returned: 0 in 0.693s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80111e8-6671-4223-b1dc-73e2b9be6e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a65e90-e826-4cec-9265-79c63a59abdd', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d468d9d6-a1ed-4efd-850f-be60fbd3dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-dcbca317-ef9e-4fdd-accf-b171eb304841" released by "delete_volume" :: held 1.758s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-a49d54c4-b003-45b2-9251-ea039677fd99-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Creating volume 3a43b3a0-1565-44cc-9a8c-b3ff7933391f from snapshot a49d54c4-b003-45b2-9251-ea039677fd99 {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Volume volume-e6a65e90-e826-4cec-9265-79c63a59abdd (e6a65e90-e826-4cec-9265-79c63a59abdd): created successfully
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d468d9d6-a1ed-4efd-850f-be60fbd3dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Flow 'volume_create_manager' (ccf90c9a-9b0a-4e32-8ba3-e72274b5290a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] snapshot: a49d54c4-b003-45b2-9251-ea039677fd99, volume: 3a43b3a0-1565-44cc-9a8c-b3ff7933391f,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:19:17 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-a3b5b531-84e3-47fa-b5d3-0e26f5a4e205 req-4c2ab9c4-3b18-417c-b636-2d1adba5dad8 tempest-VolumesGetTestJSON-897950228 None] Created volume successfully.
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Created reservations ['ff2f265f-5b76-48a4-8503-07f07d9a6e86', '00866eda-266d-43f4-b87f-c9f560dbdfe2', '230f104d-47be-440f-845a-13e0ce8d10a1', 'f8c6dcf8-b958-4050-8cbb-112261d4554c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e911c2bc-3c44-43eb-b7c1-6fa15a9f8b13]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:17 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99
Jun 24 04:19:17 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:17 devstack sudo[102277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:17 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Acquiring lock "cinder-e6a65e90-e826-4cec-9265-79c63a59abdd-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Lock "cinder-e6a65e90-e826-4cec-9265-79c63a59abdd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Acquiring lock "cinder-quobyte-e6a65e90-e826-4cec-9265-79c63a59abdd" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Lock "cinder-quobyte-e6a65e90-e826-4cec-9265-79c63a59abdd" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[556630bc-9fee-41e9-9133-fc1e4980cc17]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:17 devstack sudo[102280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd
Jun 24 04:19:17 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:18 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.830s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:18 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Deleted volume successfully.
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-968043db-9ba6-410e-a0fb-f5692f53d6dc tempest-VolumesGetTest-1886308107 None] Lock "cinder-dcbca317-ef9e-4fdd-accf-b171eb304841-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:18 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99" returned: 0 in 1.045s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ad2599-b9dc-459a-89e2-17dfe25e1033]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:18 devstack sudo[102287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928
Jun 24 04:19:18 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:18 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd" returned: 0 in 0.966s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:18 devstack sudo[102292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd
Jun 24 04:19:18 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (3a760e66-9798-46a3-b4b2-2771f94642f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa31ae44-b048-44fb-b7e7-2cce2a35ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa31ae44-b048-44fb-b7e7-2cce2a35ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1834239988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cca22ee-d913-4e70-9e82-0dbcb02fc2ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:19Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a524d33-78e5-4ef7-bf67-9ec0ec1d68f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a524d33-78e5-4ef7-bf67-9ec0ec1d68f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d03750-91d4-4f6b-8ba6-6cac041929cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:19:19 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" returned: 0 in 1.020s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:19 devstack sudo[102297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f
Jun 24 04:19:19 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d03750-91d4-4f6b-8ba6-6cac041929cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cca22ee-d913-4e70-9e82-0dbcb02fc2ff', 'volume_name': 'volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76df3230>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4a1a3d-1b52-458f-a0db-0efab9e3c46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:19 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4a1a3d-1b52-458f-a0db-0efab9e3c46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a424f1c5-4281-49a2-97ec-bbbeac85f468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:19 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Volume 6cca22ee-d913-4e70-9e82-0dbcb02fc2ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76df3230>}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Trying to clone 6cca22ee-d913-4e70-9e82-0dbcb02fc2ff from image 1fe711f9-301b-47ca-8464-f7cda30438a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e6a65e90-e826-4cec-9265-79c63a59abdd" returned: 0 in 0.936s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Lock "cinder-quobyte-e6a65e90-e826-4cec-9265-79c63a59abdd" released by "delete_volume" :: held 1.964s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:19 devstack cinder-volume[93470]: DEBUG cinder.quota [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Created reservations ['e64c4825-a8da-44cf-9072-b326df1cff83', '66b9a5c3-19c7-4e4a-adcd-f6219b4f58ce', '78679425-bf64-4d34-841d-d16a49072fe4', 'd9fb5b2f-1524-4927-a2ae-e933bec1fc76'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:20 devstack sudo[102320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:20 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:19:20 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Image download 20.69 MB at 20.69 MB/s
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb4861-41d7-443b-969d-5836a129b090]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:20 devstack sudo[102323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD
Jun 24 04:19:20 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:21 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.962s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:22 devstack cinder-volume[93470]: DEBUG cinder.manager [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Deleted volume successfully.
Jun 24 04:19:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-bb763fab-5c33-46e6-b299-51ea7e32027e req-3d5f6275-5e68-4f59-a4c0-24252acf84fd tempest-VolumesGetTestJSON-897950228 None] Lock "cinder-e6a65e90-e826-4cec-9265-79c63a59abdd-delete_volume" released by "delete_volume" :: held 4.471s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:22 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD" returned: 0 in 2.278s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:22 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Temporary image 1fe711f9-301b-47ca-8464-f7cda30438a4 is fetched for user a2198c40789e48b1ad91891ffcf7b177. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:19:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa46bfa5-0871-4c09-b39d-70c9a1c9585c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:23 devstack sudo[102355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD
Jun 24 04:19:23 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:24 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD" returned: 0 in 1.996s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:26 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" returned: 0 in 6.978s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:26 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[216815a3-c532-49f7-91a5-6cda17e9b032]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:26 devstack sudo[102388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928
Jun 24 04:19:26 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:27 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" returned: 0 in 0.986s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:27 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:19:27 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Converted 1024.00 MB image at 146.72 MB/s
Jun 24 04:19:27 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:19:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:27 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f
Jun 24 04:19:27 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:28 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" returned: 0 in 0.691s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" released by "_copy_volume_from_snapshot" :: held 10.940s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-a49d54c4-b003-45b2-9251-ea039677fd99-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" released by "_create_volume_from_snapshot" :: held 10.988s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.038s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.306s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1834239988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cca22ee-d913-4e70-9e82-0dbcb02fc2ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:19Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Creating volume 6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:28 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:28 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff 1073741824
Jun 24 04:19:28 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:28 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-259e3686-dc79-4e46-9b0b-64afd6ec088f tempest-GroupSnapshotsTest-2145445898 None] Create group from source-snapshot-cf960271-3665-465e-8e51-da4869b0a42e completed successfully.
Jun 24 04:19:29 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff 1073741824" returned: 0 in 0.927s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:29 devstack sudo[102406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff
Jun 24 04:19:29 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" acquired by "delete_volume" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:29 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c4127-1744-40fe-b300-41bcbfde36dd]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:29 devstack sudo[102418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f
Jun 24 04:19:29 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:30 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" returned: 0 in 0.894s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:30 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Attempting download of 1fe711f9-301b-47ca-8464-f7cda30438a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}])) to volume 6cca22ee-d913-4e70-9e82-0dbcb02fc2ff. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:19:30 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[87160545-0468-463d-8a78-3d495e3aab99]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_tazg9r4s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:30 devstack sudo[102434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_tazg9r4s
Jun 24 04:19:30 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:31 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" returned: 0 in 1.228s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:31 devstack sudo[102469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f
Jun 24 04:19:31 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:31 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_tazg9r4s" returned: 0 in 1.402s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_tazg9r4s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:31 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_tazg9r4s
Jun 24 04:19:31 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:31 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" returned: 0 in 0.909s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-3a43b3a0-1565-44cc-9a8c-b3ff7933391f" released by "delete_volume" :: held 2.224s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['7839f130-fd49-421d-a44b-0056d3055e4e'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:32 devstack cinder-volume[93470]: WARNING cinder.quota [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-196029414 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-196029414, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:19:32 devstack cinder-volume[93470]: WARNING cinder.quota [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-196029414 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-196029414, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['c9789c6c-db40-40f8-a775-c2aace56ba1e', '8452b8b4-5afd-4a28-b9d7-f6884faa87a8', '13e1f7dc-b349-40bb-a47a-b6ea54dd46ad', 'f8292f41-f41b-4510-9953-fd41e5253221'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:32 devstack sudo[102481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:32 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:32 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_tazg9r4s" returned: 1 in 1.013s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_tazg9r4s' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc9f66e-79c5-4ba3-9956-1a9d4562127b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:32 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] group_snapshot cf960271-3665-465e-8e51-da4869b0a42e: deleting
Jun 24 04:19:32 devstack sudo[102483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD
Jun 24 04:19:32 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] group_snapshot cf960271-3665-465e-8e51-da4869b0a42e: deleting {{(pid=93470) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-a49d54c4-b003-45b2-9251-ea039677fd99" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-a49d54c4-b003-45b2-9251-ea039677fd99" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Deleting offline snapshot a49d54c4-b003-45b2-9251-ea039677fd99 of volume 905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:19:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] snapshot_file for this snap is: volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:19:33 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[85943a4b-494c-4b41-b34b-a7c5aed7709b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:33 devstack sudo[102485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99
Jun 24 04:19:33 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:34 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:34 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.757s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:34 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8d7f0ac3-f3ac-41a9-bba8-0f01e892afe6 tempest-GroupSnapshotsTest-2145445898 None] Delete group completed successfully.
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD" returned: 0 in 1.525s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] 1fe711f9-301b-47ca-8464-f7cda30438a4 was qcow2, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:34 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff
Jun 24 04:19:34 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:34 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99" returned: 0 in 1.152s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9803c371-d659-486d-88a8-7efb8b91023f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:34 devstack sudo[102496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928
Jun 24 04:19:34 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:35 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" returned: 0 in 1.188s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:35 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99
Jun 24 04:19:35 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:36 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99" returned: 0 in 1.301s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:36 devstack sudo[102515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99
Jun 24 04:19:36 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:37 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" returned: 0 in 3.026s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:37 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_0ilm5rpkdevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:19:37 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Converted 112.00 MB image at 37.00 MB/s
Jun 24 04:19:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:37 devstack sudo[102518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff 1G
Jun 24 04:19:37 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:37 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928.a49d54c4-b003-45b2-9251-ea039677fd99" returned: 0 in 0.951s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-a49d54c4-b003-45b2-9251-ea039677fd99" released by "_delete_snapshot" :: held 4.775s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" released by "delete_snapshot" :: held 4.817s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:37 devstack cinder-volume[93470]: WARNING cinder.quota [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-196029414 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-196029414, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:19:37 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['00c14ca5-7547-4aa5-b376-e272b2243c91', '50ea9e21-9292-4e31-8099-f6beb95354b2', 'bbba54eb-c810-4099-800c-83ad9e3689fe', 'be6cfce8-5994-4028-a81d-8766677f8b02'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-099401c7-0f59-46d3-81a8-1173625c78b3 tempest-GroupSnapshotsTest-2145445898 None] group_snapshot cf960271-3665-465e-8e51-da4869b0a42e: deleted successfully
Jun 24 04:19:38 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff 1G" returned: 0 in 1.122s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19886d4-c377-4694-9dfa-e617454408c5]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:38 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff
Jun 24 04:19:38 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:39 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" returned: 0 in 0.905s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:39 devstack sudo[102528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff
Jun 24 04:19:39 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:39 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90cd62b-d5d5-4276-91a5-92811e6d8e46]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:39 devstack sudo[102530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928
Jun 24 04:19:39 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:40 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" returned: 1 in 0.966s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Downloaded image 1fe711f9-301b-47ca-8464-f7cda30438a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}])) to volume 6cca22ee-d913-4e70-9e82-0dbcb02fc2ff successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Temporary image 1fe711f9-301b-47ca-8464-f7cda30438a4 for user a2198c40789e48b1ad91891ffcf7b177 is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Marking volume 6cca22ee-d913-4e70-9e82-0dbcb02fc2ff as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Copying metadata from image 1fe711f9-301b-47ca-8464-f7cda30438a4 to 6cca22ee-d913-4e70-9e82-0dbcb02fc2ff. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Creating volume glance metadata for volume 6cca22ee-d913-4e70-9e82-0dbcb02fc2ff backed by image 1fe711f9-301b-47ca-8464-f7cda30438a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a424f1c5-4281-49a2-97ec-bbbeac85f468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76df3230>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290d4b34-c048-4b06-8766-e0c15e15d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:40 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Volume volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff (6cca22ee-d913-4e70-9e82-0dbcb02fc2ff): created successfully
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290d4b34-c048-4b06-8766-e0c15e15d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (3a760e66-9798-46a3-b4b2-2771f94642f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-cf771641-99e6-4d5b-b155-17d02c277d12 tempest-VolumesGetTest-1886308107 None] Created volume successfully.
Jun 24 04:19:40 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" returned: 0 in 1.114s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:40 devstack sudo[102552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928
Jun 24 04:19:40 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:41 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" returned: 0 in 0.929s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-905e08b1-9cc0-4ec5-b35c-be1ea2cb6928" released by "delete_volume" :: held 2.143s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['1dba0f25-4c0c-454c-9f1a-fff1b893fe7f'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:41 devstack cinder-volume[93470]: WARNING cinder.db.api [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-196029414']
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['cdc44fec-33b8-42da-acf6-99d899529614', '357ba44e-5e8c-4a40-b855-3991edbc8eb9', '63aad29d-f31c-4ce9-ad47-21d25ef52f7b', '72683a36-0f8a-40ea-8299-6d44dfc1d92d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:41 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d35e28e6-2464-4fad-ae4b-25492d4a47d6 tempest-GroupsTest-1052408405 None] Group tempest-Group1-1940918932: creating
Jun 24 04:19:41 devstack sudo[102555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:41 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:41 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d35e28e6-2464-4fad-ae4b-25492d4a47d6 tempest-GroupsTest-1052408405 None] Group tempest-Group1-1940918932: created successfully
Jun 24 04:19:41 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d35e28e6-2464-4fad-ae4b-25492d4a47d6 tempest-GroupsTest-1052408405 None] Create group completed successfully.
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (199c7cb4-27ae-4bfc-9b6a-8b104f12bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec321ab-94b7-446d-ade1-bd8fd7aa96d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec321ab-94b7-446d-ade1-bd8fd7aa96d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1844335642',display_name='tempest-VolumesGetTest-Volume-1838857634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09e64b9-d1e7-44c0-90f4-b4249dd11d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:42Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3c4d27-d4e8-4a2b-a331-d98a4ccf24dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3c4d27-d4e8-4a2b-a331-d98a4ccf24dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553a10b9-1c3e-44a3-b96f-d8f731ed60e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553a10b9-1c3e-44a3-b96f-d8f731ed60e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09e64b9-d1e7-44c0-90f4-b4249dd11d20', 'volume_name': 'volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0fcd5c-a98c-4786-9db2-951620eb2504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0fcd5c-a98c-4786-9db2-951620eb2504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c189df-3f3c-4cd3-a5d9-fecc6dc8a6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:42 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Volume f09e64b9-d1e7-44c0-90f4-b4249dd11d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20', 'volume_size': 1}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1844335642',display_name='tempest-VolumesGetTest-Volume-1838857634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09e64b9-d1e7-44c0-90f4-b4249dd11d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b40c309261429282487554b976ff3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:42Z,use_quota=True,user_id='a2198c40789e48b1ad91891ffcf7b177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Creating volume f09e64b9-d1e7-44c0-90f4-b4249dd11d20 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:42 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:42 devstack sudo[102557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20 1073741824
Jun 24 04:19:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4bb2ead1-4085-48ca-9aa9-e1fdcf580989 tempest-GroupSnapshotsTest-2145445898 None] Group tempest-GroupSnapshotsTest-Group-2059828971: creating
Jun 24 04:19:42 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4bb2ead1-4085-48ca-9aa9-e1fdcf580989 tempest-GroupSnapshotsTest-2145445898 None] Group tempest-GroupSnapshotsTest-Group-2059828971: created successfully
Jun 24 04:19:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4bb2ead1-4085-48ca-9aa9-e1fdcf580989 tempest-GroupSnapshotsTest-2145445898 None] Create group completed successfully.
Jun 24 04:19:42 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.024s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:42 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4f5982d1-fb73-415a-ba86-f2f19199a468 tempest-GroupSnapshotsTest-2145445898 None] Delete group completed successfully.
Jun 24 04:19:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-410fa94e-1d25-4b3e-84e2-76cec738480a tempest-GroupsTest-1052408405 None] Group tempest-Group2-983194807: creating
Jun 24 04:19:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-410fa94e-1d25-4b3e-84e2-76cec738480a tempest-GroupsTest-1052408405 None] Group tempest-Group2-983194807: created successfully
Jun 24 04:19:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-410fa94e-1d25-4b3e-84e2-76cec738480a tempest-GroupsTest-1052408405 None] Create group completed successfully.
Jun 24 04:19:43 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20 1073741824" returned: 0 in 0.997s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:43 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20
Jun 24 04:19:43 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Flow 'volume_create_manager' (0467fb96-e54e-4037-88d4-cea75df2b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002c16b0-a17b-45f5-bc99-4363e03b7b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002c16b0-a17b-45f5-bc99-4363e03b7b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579966088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=be2fd7a4-b313-49e4-8049-a0754ed06bc0,host='devstack@QuobyteHD#QuobyteHD',id=ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41720268fe5b4fe7b95cc95286e53e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:44Z,use_quota=True,user_id='3e326f630bf440a5beba7136794f182a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1d7a0d2-5391-4b62-9fff-f1e569568898),volume_type_id=c1d7a0d2-5391-4b62-9fff-f1e569568898)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc45451c-d02c-448f-a64f-73077894f6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc45451c-d02c-448f-a64f-73077894f6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddf5e36-bec6-4cc4-8fbd-1fde13c4985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddf5e36-bec6-4cc4-8fbd-1fde13c4985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217', 'volume_name': 'volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea324717-e764-4bfa-9833-910352212833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea324717-e764-4bfa-9833-910352212833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6c222b-84e7-4480-8743-ca1dbc76d06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:44 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Volume ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217', 'volume_size': 1}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:44 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20" returned: 0 in 0.871s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=be2fd7a4-b313-49e4-8049-a0754ed06bc0,created_at=2026-06-24T02:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579966088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=be2fd7a4-b313-49e4-8049-a0754ed06bc0,host='devstack@QuobyteHD#QuobyteHD',id=ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41720268fe5b4fe7b95cc95286e53e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:44Z,use_quota=True,user_id='3e326f630bf440a5beba7136794f182a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1d7a0d2-5391-4b62-9fff-f1e569568898),volume_type_id=c1d7a0d2-5391-4b62-9fff-f1e569568898)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Creating volume ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:44 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c189df-3f3c-4cd3-a5d9-fecc6dc8a6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd76705-d678-4d95-b95f-9ed21f1e9319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:44 devstack sudo[102566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 1073741824
Jun 24 04:19:44 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:44 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Volume volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20 (f09e64b9-d1e7-44c0-90f4-b4249dd11d20): created successfully
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd76705-d678-4d95-b95f-9ed21f1e9319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Flow 'volume_create_manager' (199c7cb4-27ae-4bfc-9b6a-8b104f12bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:44 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1bb50c2e-1d07-4b72-91e3-3a636679ad80 tempest-VolumesGetTest-1886308107 None] Created volume successfully.
Jun 24 04:19:44 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Flow 'volume_create_manager' (042b624a-b940-44d0-95e6-40f6517224de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8abc3a-380b-411a-a2f0-01eb0afeeb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8abc3a-380b-411a-a2f0-01eb0afeeb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-835059808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=51a6dd42-6b75-4906-bc28-12592d230e95,host='devstack@QuobyteHD#QuobyteHD',id=ed1ae367-c246-4b14-b367-ad1ec9e0f0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1d977c264aabbbd5c32513713460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:45Z,use_quota=True,user_id='d33585d3c7ab4b0f81714f2f15d077bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afe2b431-aeb9-4b3b-97a4-adcac6193c2c),volume_type_id=afe2b431-aeb9-4b3b-97a4-adcac6193c2c)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6048ca45-11a6-4a4e-bed6-73ce3b7dd98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6048ca45-11a6-4a4e-bed6-73ce3b7dd98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a6c53c-a7ee-4118-bb81-0c259bcf1f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a6c53c-a7ee-4118-bb81-0c259bcf1f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1ae367-c246-4b14-b367-ad1ec9e0f0d7', 'volume_name': 'volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d23e51b-2677-431a-abcf-59202d22c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d23e51b-2677-431a-abcf-59202d22c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98e0d48-653e-470e-b57a-93126a909880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:45 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Volume ed1ae367-c246-4b14-b367-ad1ec9e0f0d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7', 'volume_size': 1}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:45 devstack sudo[102591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:45 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:45 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 1073741824" returned: 0 in 1.080s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:45 devstack sudo[102596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217
Jun 24 04:19:45 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-f09e64b9-d1e7-44c0-90f4-b4249dd11d20-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Lock "cinder-f09e64b9-d1e7-44c0-90f4-b4249dd11d20-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-f09e64b9-d1e7-44c0-90f4-b4249dd11d20" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-f09e64b9-d1e7-44c0-90f4-b4249dd11d20" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[082dac05-2333-4a1d-94ba-373a310fd220]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:45 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:45 devstack sudo[102599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20
Jun 24 04:19:45 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.683s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:19:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:19:46 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" returned: 0 in 0.682s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=51a6dd42-6b75-4906-bc28-12592d230e95,created_at=2026-06-24T02:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-835059808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=51a6dd42-6b75-4906-bc28-12592d230e95,host='devstack@QuobyteHD#QuobyteHD',id=ed1ae367-c246-4b14-b367-ad1ec9e0f0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1d977c264aabbbd5c32513713460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:45Z,use_quota=True,user_id='d33585d3c7ab4b0f81714f2f15d077bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afe2b431-aeb9-4b3b-97a4-adcac6193c2c),volume_type_id=afe2b431-aeb9-4b3b-97a4-adcac6193c2c)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Creating volume ed1ae367-c246-4b14-b367-ad1ec9e0f0d7 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:46 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6c222b-84e7-4480-8743-ca1dbc76d06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8a7169-b137-41f9-96c3-38d801876d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:46 devstack sudo[102602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7 1073741824
Jun 24 04:19:46 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:46 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Volume volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 (ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217): created successfully
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8a7169-b137-41f9-96c3-38d801876d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Flow 'volume_create_manager' (0467fb96-e54e-4037-88d4-cea75df2b224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c0a28641-4afa-452a-8ae9-1e2bef47e38d tempest-GroupSnapshotsTest-2145445898 None] Created volume successfully.
Jun 24 04:19:46 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20" returned: 0 in 0.767s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:46 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20
Jun 24 04:19:46 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:47 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Flow 'volume_create_manager' (7abbecb3-fe96-4177-a1f4-ecc3b73e9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:47 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3215afc-7026-4f7f-ba57-be5a81c2f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f09e64b9-d1e7-44c0-90f4-b4249dd11d20" returned: 0 in 0.764s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7 1073741824" returned: 0 in 1.036s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-f09e64b9-d1e7-44c0-90f4-b4249dd11d20" released by "delete_volume" :: held 1.585s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3215afc-7026-4f7f-ba57-be5a81c2f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-165210949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=be2fd7a4-b313-49e4-8049-a0754ed06bc0,host='devstack@QuobyteHD#QuobyteHD',id=e84902d7-fdad-4795-9991-63e8a7fca6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41720268fe5b4fe7b95cc95286e53e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:47Z,use_quota=True,user_id='3e326f630bf440a5beba7136794f182a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1d7a0d2-5391-4b62-9fff-f1e569568898),volume_type_id=c1d7a0d2-5391-4b62-9fff-f1e569568898)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7da53d-2e5a-411e-91ed-697e90fdb204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7da53d-2e5a-411e-91ed-697e90fdb204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70344e8b-15cd-4995-b564-330277aba6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70344e8b-15cd-4995-b564-330277aba6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84902d7-fdad-4795-9991-63e8a7fca6ce', 'volume_name': 'volume-e84902d7-fdad-4795-9991-63e8a7fca6ce', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bc16ae-7d1d-423d-be0c-81859f29c555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bc16ae-7d1d-423d-be0c-81859f29c555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05818ab8-6ab7-4ed9-8a7d-52aef6889fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:47 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Volume e84902d7-fdad-4795-9991-63e8a7fca6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84902d7-fdad-4795-9991-63e8a7fca6ce', 'volume_size': 1}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:47 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7
Jun 24 04:19:47 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Created reservations ['fbbcd609-2982-4456-a775-2d04f8706b78', 'bb3726a0-4e78-4dee-99de-2d504ad8bf99', 'a424aec1-4245-426f-ac37-f8debbb59b1a', '408d5863-c41c-448d-84e2-cf8093e9c95c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:47 devstack sudo[102616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:47 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Lock "cinder-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Acquiring lock "cinder-quobyte-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:48 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7" returned: 0 in 0.710s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=be2fd7a4-b313-49e4-8049-a0754ed06bc0,created_at=2026-06-24T02:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-165210949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=be2fd7a4-b313-49e4-8049-a0754ed06bc0,host='devstack@QuobyteHD#QuobyteHD',id=e84902d7-fdad-4795-9991-63e8a7fca6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41720268fe5b4fe7b95cc95286e53e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:47Z,use_quota=True,user_id='3e326f630bf440a5beba7136794f182a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1d7a0d2-5391-4b62-9fff-f1e569568898),volume_type_id=c1d7a0d2-5391-4b62-9fff-f1e569568898)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Creating volume e84902d7-fdad-4795-9991-63e8a7fca6ce {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:48 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50101c7-6c38-4e2c-bb01-26a6b7f5735c]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:48 devstack sudo[102620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce 1073741824
Jun 24 04:19:48 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:48 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98e0d48-653e-470e-b57a-93126a909880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb9ba53-6ccd-4ce8-af1b-d77f68805957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.687s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:48 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Volume volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7 (ed1ae367-c246-4b14-b367-ad1ec9e0f0d7): created successfully
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb9ba53-6ccd-4ce8-af1b-d77f68805957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Flow 'volume_create_manager' (042b624a-b940-44d0-95e6-40f6517224de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:48 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Deleted volume successfully.
Jun 24 04:19:48 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1a77d9d4-3c7a-404c-8640-65d1aa58beb2 tempest-GroupsTest-1052408405 None] Created volume successfully.
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-39b1abd1-8c27-4069-b928-109eac225d1e tempest-VolumesGetTest-1886308107 None] Lock "cinder-f09e64b9-d1e7-44c0-90f4-b4249dd11d20-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:48 devstack sudo[102621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff
Jun 24 04:19:48 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:48 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" returned: 0 in 0.780s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:49 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce 1073741824" returned: 0 in 0.875s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:49 devstack sudo[102630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff
Jun 24 04:19:49 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:49 devstack sudo[102632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce
Jun 24 04:19:49 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Acquiring lock "cinder-quobyte-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Lock "cinder-quobyte-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[648d62a9-5f0f-4752-883a-a14b7656b219]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:49 devstack sudo[102634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7
Jun 24 04:19:49 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:49 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" returned: 1 in 0.797s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:49 devstack sudo[102640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff
Jun 24 04:19:49 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:49 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce" returned: 0 in 0.706s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05818ab8-6ab7-4ed9-8a7d-52aef6889fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84902d7-fdad-4795-9991-63e8a7fca6ce', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c7aea1-4b8b-44bd-826d-ebe71d6399de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Volume volume-e84902d7-fdad-4795-9991-63e8a7fca6ce (e84902d7-fdad-4795-9991-63e8a7fca6ce): created successfully
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c7aea1-4b8b-44bd-826d-ebe71d6399de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Flow 'volume_create_manager' (7abbecb3-fe96-4177-a1f4-ecc3b73e9d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-47ce50a6-1d11-435a-acc9-496f48ddee2f tempest-GroupSnapshotsTest-2145445898 None] Created volume successfully.
Jun 24 04:19:50 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7" returned: 0 in 0.829s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:50 devstack sudo[102645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7
Jun 24 04:19:50 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:50 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" returned: 0 in 0.666s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Lock "cinder-quobyte-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff" released by "delete_volume" :: held 2.341s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Created reservations ['73c6e5d3-4af7-4180-8c12-3c814e8472d9', '964b4676-c462-48eb-b486-971758c89e7d', '08be28bc-001a-443f-8a5f-b260f8408185', '30783143-d0f7-4180-ae6d-7502e65cc9f1'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:50 devstack sudo[102648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:50 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:50 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7" returned: 0 in 0.714s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Lock "cinder-quobyte-ed1ae367-c246-4b14-b367-ad1ec9e0f0d7" released by "delete_volume" :: held 1.597s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:50 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Created reservations ['337acc32-a4df-444b-a292-8f91100e6f20'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-afe1a83f-f87b-494c-902b-24ff5558accf tempest-GroupSnapshotsTest-2145445898 None] Update group completed successfully.
Jun 24 04:19:51 devstack cinder-volume[93470]: WARNING cinder.quota [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1913138394 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1913138394, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:19:51 devstack cinder-volume[93470]: WARNING cinder.quota [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1913138394 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1913138394, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Created reservations ['b5315d65-fa3d-4598-9c18-dc68d096a4ab', 'b9cd6e06-d854-4aec-a487-984a7e95cf88', '5968d26d-2c21-4930-89ab-760746bd4efa', '13af9983-40b0-4f4a-b4db-df2bf27b2b8c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:51 devstack sudo[102652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:51 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:51 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.668s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Deleted volume successfully.
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3d7735f4-f91a-435a-8d5d-f16d840736f8 tempest-VolumesGetTest-1886308107 None] Lock "cinder-6cca22ee-d913-4e70-9e82-0dbcb02fc2ff-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Created reservations ['a183ff58-4be3-42f4-80d0-088dfd11b01d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:51 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.734s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4d036421-4049-48ca-bc02-9471a6ebcc47 tempest-GroupsTest-1052408405 None] Delete group completed successfully.
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:51 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:19:51 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-7c3e23c9-ad54-4d0e-b6c6-56b057c02514 tempest-GroupSnapshotsTest-2145445898 None] Update group completed successfully.
Jun 24 04:19:52 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.793s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:52 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8fb91ccd-e4b3-4974-9d5c-b0cdff485bd3 tempest-GroupsTest-1052408405 None] Delete group completed successfully.
Jun 24 04:19:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-01cc8404-f98f-4fcf-a9a7-df4b1f5c5fee tempest-GroupSnapshotsTest-2145445898 None] Update group completed successfully.
Jun 24 04:19:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-846696e9-50e0-4afa-a075-568b8eb0e8d7 tempest-GroupsTest-1052408405 None] Group tempest-GroupsTest-Group-2027725324: creating
Jun 24 04:19:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-846696e9-50e0-4afa-a075-568b8eb0e8d7 tempest-GroupsTest-1052408405 None] Group tempest-GroupsTest-Group-2027725324: created successfully
Jun 24 04:19:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-846696e9-50e0-4afa-a075-568b8eb0e8d7 tempest-GroupsTest-1052408405 None] Create group completed successfully.
Jun 24 04:19:54 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9e2e7f65-44c7-4946-8158-cc85f3c973ae tempest-GroupSnapshotsTest-2145445898 None] Update group completed successfully.
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Flow 'volume_create_manager' (3718e5b5-0b4a-470d-8ead-5b981b0d5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48761c13-eab0-49cd-9684-fcd7d6df4e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48761c13-eab0-49cd-9684-fcd7d6df4e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1367336160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=97090276-2ecb-4cb5-89c4-7d35f6a4b4c2,host='devstack@QuobyteHD#QuobyteHD',id=6351265d-0d76-48fa-9141-ff190c71e0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1d977c264aabbbd5c32513713460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:55Z,use_quota=True,user_id='d33585d3c7ab4b0f81714f2f15d077bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e1703a-65a9-491e-998f-3d847c137fb8),volume_type_id=a3e1703a-65a9-491e-998f-3d847c137fb8)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc38a92-43e8-406b-9b1d-3e1d5b45dda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc38a92-43e8-406b-9b1d-3e1d5b45dda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4a1ea5-3a5a-4a00-bacc-949bdfeb2190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4a1ea5-3a5a-4a00-bacc-949bdfeb2190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6351265d-0d76-48fa-9141-ff190c71e0d2', 'volume_name': 'volume-6351265d-0d76-48fa-9141-ff190c71e0d2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085c0dd8-1695-46f4-9cbf-cfd262a145a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085c0dd8-1695-46f4-9cbf-cfd262a145a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3bbb6f-95dd-4574-b5b5-c0cddd96aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:55 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Volume 6351265d-0d76-48fa-9141-ff190c71e0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6351265d-0d76-48fa-9141-ff190c71e0d2', 'volume_size': 1}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=97090276-2ecb-4cb5-89c4-7d35f6a4b4c2,created_at=2026-06-24T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1367336160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=97090276-2ecb-4cb5-89c4-7d35f6a4b4c2,host='devstack@QuobyteHD#QuobyteHD',id=6351265d-0d76-48fa-9141-ff190c71e0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1d977c264aabbbd5c32513713460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:55Z,use_quota=True,user_id='d33585d3c7ab4b0f81714f2f15d077bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e1703a-65a9-491e-998f-3d847c137fb8),volume_type_id=a3e1703a-65a9-491e-998f-3d847c137fb8)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Creating volume 6351265d-0d76-48fa-9141-ff190c71e0d2 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:55 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:19:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:55 devstack sudo[102678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2 1073741824
Jun 24 04:19:55 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] GroupSnapshot 3861575d-8df2-4365-a974-9dcf459dc8ab: creating.
Jun 24 04:19:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Group snapshot 3861575d-8df2-4365-a974-9dcf459dc8ab: creating. {{(pid=93470) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 24 04:19:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:56 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2 1073741824" returned: 0 in 1.019s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:56 devstack sudo[102685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2
Jun 24 04:19:56 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:57 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2" returned: 0 in 0.716s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.827s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Creating offline snapshot 21ee489c-c293-46b8-8ead-0e079fb05780 of volume e84902d7-fdad-4795-9991-63e8a7fca6ce {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3bbb6f-95dd-4574-b5b5-c0cddd96aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6351265d-0d76-48fa-9141-ff190c71e0d2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b8b4e9-bf06-4384-a40d-fccd135bb304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafa665a-d660-4297-8a43-b917570b0319]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:57 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Volume volume-6351265d-0d76-48fa-9141-ff190c71e0d2 (6351265d-0d76-48fa-9141-ff190c71e0d2): created successfully
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b8b4e9-bf06-4384-a40d-fccd135bb304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Flow 'volume_create_manager' (3718e5b5-0b4a-470d-8ead-5b981b0d5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:57 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-eea061d5-3e5e-4d49-8f96-eba0e5b70b5f tempest-GroupsTest-1052408405 None] Created volume successfully.
Jun 24 04:19:57 devstack sudo[102691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce
Jun 24 04:19:57 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Flow 'volume_create_manager' (9e2c3f79-8544-4eee-b794-7e66c86c9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21509094-5e56-44ea-9696-f1cf062d1e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21509094-5e56-44ea-9696-f1cf062d1e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-267219052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96cc158-adad-46fd-91e9-21f1fd787ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5825434a85b4095ad08fbe971b7c59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:58Z,use_quota=True,user_id='68c41db42590496287f5bce3598c2e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3fc92f-9311-4583-9d65-5638d7016ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3fc92f-9311-4583-9d65-5638d7016ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceee77f-ea3c-4ca7-b373-205823995208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceee77f-ea3c-4ca7-b373-205823995208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96cc158-adad-46fd-91e9-21f1fd787ac8', 'volume_name': 'volume-d96cc158-adad-46fd-91e9-21f1fd787ac8', 'volume_size': 2}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf10f79d-4ad8-4280-977c-41249127a94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf10f79d-4ad8-4280-977c-41249127a94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382b33ac-4e21-4154-a724-5c82d93a85a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:57 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Volume d96cc158-adad-46fd-91e9-21f1fd787ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96cc158-adad-46fd-91e9-21f1fd787ac8', 'volume_size': 2}
Jun 24 04:19:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:58 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce" returned: 0 in 0.992s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:58 devstack sudo[102710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 1G
Jun 24 04:19:58 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Flow 'volume_create_manager' (fb2940d9-dd48-46ba-adb6-b4a63f840d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adf15f1-c67b-4751-9f1a-4189f70f6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adf15f1-c67b-4751-9f1a-4189f70f6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1317687472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=97090276-2ecb-4cb5-89c4-7d35f6a4b4c2,host='devstack@QuobyteHD#QuobyteHD',id=578f6904-9ec7-48fd-8e19-16e274560693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1d977c264aabbbd5c32513713460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:58Z,use_quota=True,user_id='d33585d3c7ab4b0f81714f2f15d077bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e1703a-65a9-491e-998f-3d847c137fb8),volume_type_id=a3e1703a-65a9-491e-998f-3d847c137fb8)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8ce5e1-a1cc-48f1-ba10-341fc8d7adf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8ce5e1-a1cc-48f1-ba10-341fc8d7adf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc05208f-0680-40ac-b6b0-10a27153eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc05208f-0680-40ac-b6b0-10a27153eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '578f6904-9ec7-48fd-8e19-16e274560693', 'volume_name': 'volume-578f6904-9ec7-48fd-8e19-16e274560693', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f50ef-6b99-465d-81b8-00fdf90edd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f50ef-6b99-465d-81b8-00fdf90edd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c515572-4faa-435c-88fa-cc9c2321c671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:58 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Volume 578f6904-9ec7-48fd-8e19-16e274560693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-578f6904-9ec7-48fd-8e19-16e274560693', 'volume_size': 1}
Jun 24 04:19:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:59 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 1G" returned: 0 in 0.972s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84902d7-fdad-4795-9991-63e8a7fca6ce -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:59 devstack sudo[102740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84902d7-fdad-4795-9991-63e8a7fca6ce -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780
Jun 24 04:19:59 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:59 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84902d7-fdad-4795-9991-63e8a7fca6ce -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780" returned: 0 in 0.714s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:59 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:19:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:59 devstack sudo[102746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780
Jun 24 04:19:59 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780" returned: 0 in 0.669s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:00 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=125,cinder:UPDATE=145,cinder:DELETE=7,cinder:INSERT=38 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:20:00 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=143,cinder:UPDATE=143,cinder:INSERT=34,cinder:DELETE=10 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:20:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:00 devstack sudo[102751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.info
Jun 24 04:20:00 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:01 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.info" returned: 0 in 0.648s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:01 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:01 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.info
Jun 24 04:20:01 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:01 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.info" returned: 0 in 0.653s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.756s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Creating offline snapshot b2ffe648-cf3b-4b3d-9049-daeb65d43b95 of volume ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[766be898-4c18-4515-8acd-a99337ae7385]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:02 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217
Jun 24 04:20:02 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:02 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" returned: 0 in 0.753s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:02 devstack sudo[102765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 1G
Jun 24 04:20:02 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:03 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 1G" returned: 0 in 0.862s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:03 devstack sudo[102771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95
Jun 24 04:20:03 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:04 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95" returned: 0 in 0.692s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:04 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:20:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:04 devstack sudo[102776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95
Jun 24 04:20:04 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:04 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95" returned: 0 in 0.697s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:05 devstack sudo[102780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.info
Jun 24 04:20:05 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:05 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.info" returned: 0 in 0.712s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:05 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:20:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:05 devstack sudo[102786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.info
Jun 24 04:20:05 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:06 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.info" returned: 0 in 0.665s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.709s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=97090276-2ecb-4cb5-89c4-7d35f6a4b4c2,created_at=2026-06-24T02:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1317687472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=97090276-2ecb-4cb5-89c4-7d35f6a4b4c2,host='devstack@QuobyteHD#QuobyteHD',id=578f6904-9ec7-48fd-8e19-16e274560693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8c1d977c264aabbbd5c32513713460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:58Z,use_quota=True,user_id='d33585d3c7ab4b0f81714f2f15d077bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e1703a-65a9-491e-998f-3d847c137fb8),volume_type_id=a3e1703a-65a9-491e-998f-3d847c137fb8)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Creating volume 578f6904-9ec7-48fd-8e19-16e274560693 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:20:06 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:20:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:06 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693 1073741824
Jun 24 04:20:06 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ad26f209-bf85-4452-bb18-29a01e469a55 tempest-GroupSnapshotsTest-2145445898 None] group_snapshot 3861575d-8df2-4365-a974-9dcf459dc8ab: created successfully
Jun 24 04:20:07 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] group_snapshot 3861575d-8df2-4365-a974-9dcf459dc8ab: deleting
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] group_snapshot 3861575d-8df2-4365-a974-9dcf459dc8ab: deleting {{(pid=93470) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-e84902d7-fdad-4795-9991-63e8a7fca6ce" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-e84902d7-fdad-4795-9991-63e8a7fca6ce" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-21ee489c-c293-46b8-8ead-0e079fb05780" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-21ee489c-c293-46b8-8ead-0e079fb05780" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Deleting offline snapshot 21ee489c-c293-46b8-8ead-0e079fb05780 of volume e84902d7-fdad-4795-9991-63e8a7fca6ce {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] snapshot_file for this snap is: volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d3bdc-7971-4feb-85de-b424ed47b631]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:07 devstack sudo[102799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780
Jun 24 04:20:07 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:07 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693 1073741824" returned: 0 in 0.990s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:07 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-919a2644-842c-421f-9fdb-794a6416207b req-aa3b240a-c971-4e96-961a-186dc9bb24ec tempest-AttachVolumeNegativeTest-596704228 None] Terminate volume connection completed successfully.
Jun 24 04:20:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-919a2644-842c-421f-9fdb-794a6416207b req-aa3b240a-c971-4e96-961a-186dc9bb24ec tempest-AttachVolumeNegativeTest-596704228 None] Deleting attachment 3e8883b3-8ada-4284-90db-963b1a7c565a. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:20:07 devstack sudo[102807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693
Jun 24 04:20:07 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:08 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780" returned: 0 in 0.880s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84902d7-fdad-4795-9991-63e8a7fca6ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9907af49-f1c6-4ea0-9e84-c3805532d08d]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:08 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693" returned: 0 in 0.671s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.207s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-267219052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96cc158-adad-46fd-91e9-21f1fd787ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5825434a85b4095ad08fbe971b7c59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:58Z,use_quota=True,user_id='68c41db42590496287f5bce3598c2e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Creating volume d96cc158-adad-46fd-91e9-21f1fd787ac8 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:20:08 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 2147483648 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c515572-4faa-435c-88fa-cc9c2321c671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578f6904-9ec7-48fd-8e19-16e274560693', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:08 devstack sudo[102813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce
Jun 24 04:20:08 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:08 devstack sudo[102814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 2147483648
Jun 24 04:20:08 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d50803-ecec-4aba-a356-d9d502f58960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:08 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Volume volume-578f6904-9ec7-48fd-8e19-16e274560693 (578f6904-9ec7-48fd-8e19-16e274560693): created successfully
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d50803-ecec-4aba-a356-d9d502f58960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Flow 'volume_create_manager' (fb2940d9-dd48-46ba-adb6-b4a63f840d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-bc1ebe2f-5ce3-40fa-9173-3cf8cc33dd1a tempest-GroupsTest-1052408405 None] Created volume successfully.
Jun 24 04:20:08 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce" returned: 0 in 0.806s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:08 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780
Jun 24 04:20:08 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:09 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 2147483648" returned: 0 in 0.889s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:09 devstack sudo[102826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8
Jun 24 04:20:09 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:09 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0b7bf310-0749-4e07-b901-4429fb205457 tempest-GroupsTest-1052408405 None] Update group completed successfully.
Jun 24 04:20:09 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780" returned: 0 in 0.922s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:09 devstack sudo[102833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780
Jun 24 04:20:09 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:09 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8" returned: 0 in 0.783s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382b33ac-4e21-4154-a724-5c82d93a85a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96cc158-adad-46fd-91e9-21f1fd787ac8', 'volume_size': 2}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eed6012-44fc-490d-8bb3-174b0a83a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:09 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Volume volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 (d96cc158-adad-46fd-91e9-21f1fd787ac8): created successfully
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eed6012-44fc-490d-8bb3-174b0a83a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Flow 'volume_create_manager' (9e2c3f79-8544-4eee-b794-7e66c86c9074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6a3947f3-f808-4399-aa44-6284c6aa7a24 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Created volume successfully.
Jun 24 04:20:10 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce.21ee489c-c293-46b8-8ead-0e079fb05780" returned: 0 in 0.683s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-21ee489c-c293-46b8-8ead-0e079fb05780" released by "_delete_snapshot" :: held 3.477s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-e84902d7-fdad-4795-9991-63e8a7fca6ce" released by "delete_snapshot" :: held 3.532s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-b2ffe648-cf3b-4b3d-9049-daeb65d43b95" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-b2ffe648-cf3b-4b3d-9049-daeb65d43b95" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Deleting offline snapshot b2ffe648-cf3b-4b3d-9049-daeb65d43b95 of volume ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] snapshot_file for this snap is: volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b47ca0-7081-4b4e-b6c4-fbaafe8643fc]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:10 devstack sudo[102895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95
Jun 24 04:20:10 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Creating offline snapshot ba326e42-8a41-44a2-afb0-73405ed8f7f0 of volume d96cc158-adad-46fd-91e9-21f1fd787ac8 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6758f01d-5db1-4a74-80cc-d19c7fe93c6d]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:11 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-97445489-e366-4c18-b7c2-46768df58ced tempest-GroupsTest-1052408405 None] Update group completed successfully.
Jun 24 04:20:11 devstack sudo[102914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8
Jun 24 04:20:11 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:11 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95" returned: 0 in 1.001s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de0368f-d8da-4b43-8160-b42eebda5eeb]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:11 devstack sudo[102920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217
Jun 24 04:20:11 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:12 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8" returned: 0 in 0.834s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 2G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:12 devstack sudo[102926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 2G
Jun 24 04:20:12 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:12 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" returned: 0 in 0.944s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:12 devstack sudo[102934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95
Jun 24 04:20:12 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Acquiring lock "cinder-quobyte-578f6904-9ec7-48fd-8e19-16e274560693" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Lock "cinder-quobyte-578f6904-9ec7-48fd-8e19-16e274560693" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:13 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d04eb2b-21f4-41ce-8d7e-3975fced3b32]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:13 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 2G" returned: 0 in 1.271s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:13 devstack sudo[102942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0
Jun 24 04:20:13 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:13 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693
Jun 24 04:20:13 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:13 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95" returned: 0 in 0.868s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:13 devstack sudo[102949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95
Jun 24 04:20:13 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:14 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693" returned: 0 in 0.940s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:14 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693
Jun 24 04:20:14 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:14 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0" returned: 0 in 0.834s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:14 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 is being set with open permissions: ugo+rw
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:14 devstack sudo[102959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0
Jun 24 04:20:14 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:14 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217.b2ffe648-cf3b-4b3d-9049-daeb65d43b95" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-b2ffe648-cf3b-4b3d-9049-daeb65d43b95" released by "_delete_snapshot" :: held 3.675s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" released by "delete_snapshot" :: held 3.729s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:14 devstack cinder-volume[93470]: WARNING cinder.quota [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-842908464 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-842908464, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:20:14 devstack cinder-volume[93470]: WARNING cinder.quota [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-842908464 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-842908464, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['a79d8ad3-7fd3-465c-83bd-38cf6ff6141a', '7e7c2b75-fc19-4171-b6f3-1a49f2ab8584', 'd3afacae-6b5b-435c-8d02-b3c62e57c25b', '887a35dc-8f09-43d3-8f75-d9660d28c712'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['96e943a0-c00c-42c7-8ddf-bfaf769b7197', 'bbfbcb77-7656-4ba7-a3c8-e5913ba4eb74', 'ddd0b471-6cdb-4b24-b714-71bd10e3568a', '20d91979-cfea-4f91-8b53-19e52fbc98ae'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:14 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-578f6904-9ec7-48fd-8e19-16e274560693" returned: 0 in 0.668s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Lock "cinder-quobyte-578f6904-9ec7-48fd-8e19-16e274560693" released by "delete_volume" :: held 1.671s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Acquiring lock "cinder-quobyte-6351265d-0d76-48fa-9141-ff190c71e0d2" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Lock "cinder-quobyte-6351265d-0d76-48fa-9141-ff190c71e0d2" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6becf-9c8d-4e9e-84f0-95359820668a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:14 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d5a84b11-b550-45e4-9f52-187eef60b303 tempest-GroupSnapshotsTest-2145445898 None] group_snapshot 3861575d-8df2-4365-a974-9dcf459dc8ab: deleted successfully
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0" returned: 0 in 0.685s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:14 devstack sudo[102965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.info
Jun 24 04:20:14 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:14 devstack sudo[102964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2
Jun 24 04:20:14 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-e84902d7-fdad-4795-9991-63e8a7fca6ce" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-e84902d7-fdad-4795-9991-63e8a7fca6ce" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:15 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafac78a-e337-4cf5-b9ee-d4859e897e9a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:15 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.info" returned: 0 in 0.816s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:15 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.info is being set with open permissions: ugo+rw
Jun 24 04:20:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:15 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce
Jun 24 04:20:15 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:15 devstack sudo[102974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.info
Jun 24 04:20:15 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:15 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2" returned: 0 in 0.972s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:15 devstack sudo[102977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2
Jun 24 04:20:15 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:16 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.info" returned: 0 in 0.691s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.249s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:16 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce" returned: 0 in 0.862s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:16 devstack sudo[102985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce
Jun 24 04:20:16 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:16 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0bc05b46-ee9a-48c0-a59a-fa4c89450739 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Create snapshot completed successfully
Jun 24 04:20:16 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6351265d-0d76-48fa-9141-ff190c71e0d2" returned: 0 in 0.718s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Lock "cinder-quobyte-6351265d-0d76-48fa-9141-ff190c71e0d2" released by "delete_volume" :: held 1.743s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Created reservations ['cd52b26e-9449-4691-8016-cd026bc8a825'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:16 devstack cinder-volume[93470]: WARNING cinder.quota [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1351648437 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1351648437, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:20:16 devstack cinder-volume[93470]: WARNING cinder.quota [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1351648437 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1351648437, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Created reservations ['b3386acf-990e-49e2-9d11-8bb837f83df2', '7740c108-c595-44ce-bc94-b6fcc053825f', '4fb8edf9-0e5b-4b7b-ba9c-1960a958e6a6', 'feeff1de-f495-498c-8e15-0351a70aeb67'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Created reservations ['0e5ae625-64c0-4c18-94a4-bdf6c309a9d2', '77a4776f-c3da-493b-93cc-08493000a680', '0d8b8d59-b604-441b-bdb2-3330198f9549', 'aa973d71-86d1-42f9-82fe-63a5d05c676e'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:16 devstack sudo[102987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:20:16 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:17 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e84902d7-fdad-4795-9991-63e8a7fca6ce" returned: 0 in 0.749s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-e84902d7-fdad-4795-9991-63e8a7fca6ce" released by "delete_volume" :: held 1.696s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb57fba-90cc-43b2-b1b2-e21dba338de8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:17 devstack sudo[102990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217
Jun 24 04:20:17 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:17 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.883s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "cinder-ba326e42-8a41-44a2-afb0-73405ed8f7f0-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:17 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8bc6d64c-8d00-4a4e-b5a1-a2f262f6171a tempest-GroupsTest-1052408405 None] Delete group completed successfully.
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-ba326e42-8a41-44a2-afb0-73405ed8f7f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "cinder-quobyte-d96cc158-adad-46fd-91e9-21f1fd787ac8" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-quobyte-d96cc158-adad-46fd-91e9-21f1fd787ac8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "cinder-quobyte-ba326e42-8a41-44a2-afb0-73405ed8f7f0" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-quobyte-ba326e42-8a41-44a2-afb0-73405ed8f7f0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Deleting offline snapshot ba326e42-8a41-44a2-afb0-73405ed8f7f0 of volume d96cc158-adad-46fd-91e9-21f1fd787ac8 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] snapshot_file for this snap is: volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95ed02-bd89-4ada-976b-b8890a455b3c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:18 devstack sudo[102993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0
Jun 24 04:20:18 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:18 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" returned: 0 in 1.032s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:18 devstack sudo[102999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217
Jun 24 04:20:18 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:19 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0" returned: 0 in 1.097s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d96cc158-adad-46fd-91e9-21f1fd787ac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d949317-a47b-435b-83df-0861a55f9271]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:19 devstack sudo[103004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8
Jun 24 04:20:19 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:19 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" returned: 0 in 0.927s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-ecf53ec1-ccf8-43f4-951f-fd1d1c7ce217" released by "delete_volume" :: held 2.035s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['027a554d-8f66-4ab0-8be2-f65171247bb3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:19 devstack cinder-volume[93470]: WARNING cinder.quota [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-842908464 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-842908464, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['30b53bf1-b230-4118-9623-19b908c81c3d', '36e9911e-9cfc-469c-8e0e-b6aefa84e1f4', '36c3e51f-d145-4897-a71f-2d5c31f1ae7c', 'c82033fb-7072-4c9d-863b-ea21ee4871c3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['366aa382-2c0a-468c-a507-e70bb842957b', '1c3e5965-74f6-4db6-8b1c-db90cfc9667e', 'c8d8fa8b-05df-4305-9eed-e4ebe8002b37', '2cb1773d-edab-41c9-98ef-a733e192344f'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:19 devstack sudo[103007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:20:19 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:20 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8" returned: 0 in 1.030s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:20 devstack sudo[103012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0
Jun 24 04:20:20 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:20 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.780s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:20 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:20 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-40fc7b42-349d-4cc2-8118-ad3b515b99c6 tempest-GroupSnapshotsTest-2145445898 None] Delete group completed successfully.
Jun 24 04:20:21 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0" returned: 0 in 1.047s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:21 devstack sudo[103018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0
Jun 24 04:20:21 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9cc040b4-e9a3-476a-8e38-c20e25e4e1ff tempest-GroupSnapshotsTest-2145445898 None] Group tempest-GroupSnapshotsTest-Group-1234688266: creating
Jun 24 04:20:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9cc040b4-e9a3-476a-8e38-c20e25e4e1ff tempest-GroupSnapshotsTest-2145445898 None] Group tempest-GroupSnapshotsTest-Group-1234688266: created successfully
Jun 24 04:20:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9cc040b4-e9a3-476a-8e38-c20e25e4e1ff tempest-GroupSnapshotsTest-2145445898 None] Create group completed successfully.
Jun 24 04:20:21 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8.ba326e42-8a41-44a2-afb0-73405ed8f7f0" returned: 0 in 0.789s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-quobyte-ba326e42-8a41-44a2-afb0-73405ed8f7f0" released by "_delete_snapshot" :: held 4.115s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-quobyte-d96cc158-adad-46fd-91e9-21f1fd787ac8" released by "delete_snapshot" :: held 4.145s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:22 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Created reservations ['021cb003-5201-4029-ac16-2a1b5d5906ef', '7033e044-dc80-493c-9db7-0894d138ef77', '135b89e1-5da1-4675-b35c-988188e71e4c', '987f10ad-ca05-4aaa-a56e-57bcd3c1ab6b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Delete snapshot completed successfully.
Jun 24 04:20:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1c2ad64e-bcdc-470a-a0a3-eceafa6c4c92 tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-ba326e42-8a41-44a2-afb0-73405ed8f7f0-delete_snapshot" released by "delete_snapshot" :: held 4.325s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Flow 'volume_create_manager' (7a2a213c-94a5-48ea-91d6-6f72d3e8ba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b007763c-63cb-43de-8960-03fde9bd4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b007763c-63cb-43de-8960-03fde9bd4103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1141418063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9da15e76-1499-4a10-9e8a-b1d30afb498b,host='devstack@QuobyteHD#QuobyteHD',id=2cdfda09-8281-41ef-a0a0-d1d2b6dc665b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41720268fe5b4fe7b95cc95286e53e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:23Z,use_quota=True,user_id='3e326f630bf440a5beba7136794f182a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8df25d17-063c-4d88-ae74-d96d8e9775d0),volume_type_id=8df25d17-063c-4d88-ae74-d96d8e9775d0)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0638bcfc-3f2a-40cd-a827-f1543840b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0638bcfc-3f2a-40cd-a827-f1543840b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa017808-429e-47c3-b9f8-da920c14724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa017808-429e-47c3-b9f8-da920c14724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cdfda09-8281-41ef-a0a0-d1d2b6dc665b', 'volume_name': 'volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c536f60b-1b5e-45d0-bd8d-e8c02ddc8e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c536f60b-1b5e-45d0-bd8d-e8c02ddc8e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65333d95-821e-4110-a070-34c6d08769fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Volume 2cdfda09-8281-41ef-a0a0-d1d2b6dc665b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b', 'volume_size': 1}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9da15e76-1499-4a10-9e8a-b1d30afb498b,created_at=2026-06-24T02:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1141418063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9da15e76-1499-4a10-9e8a-b1d30afb498b,host='devstack@QuobyteHD#QuobyteHD',id=2cdfda09-8281-41ef-a0a0-d1d2b6dc665b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41720268fe5b4fe7b95cc95286e53e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:23Z,use_quota=True,user_id='3e326f630bf440a5beba7136794f182a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8df25d17-063c-4d88-ae74-d96d8e9775d0),volume_type_id=8df25d17-063c-4d88-ae74-d96d8e9775d0)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Creating volume 2cdfda09-8281-41ef-a0a0-d1d2b6dc665b {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:20:23 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:23 devstack sudo[103024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b 1073741824
Jun 24 04:20:23 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "cinder-d96cc158-adad-46fd-91e9-21f1fd787ac8-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-d96cc158-adad-46fd-91e9-21f1fd787ac8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "cinder-quobyte-d96cc158-adad-46fd-91e9-21f1fd787ac8" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-quobyte-d96cc158-adad-46fd-91e9-21f1fd787ac8" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4de8cc-8cbc-47e7-9711-154e85832286]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:23 devstack sudo[103027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8
Jun 24 04:20:23 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b2d658b9-2fcd-4752-a227-f4565df3bb0e tempest-GroupsV320Test-1722298524 None] Group tempest-GroupsV320Test-Group-471014642: creating
Jun 24 04:20:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b2d658b9-2fcd-4752-a227-f4565df3bb0e tempest-GroupsV320Test-1722298524 None] Group tempest-GroupsV320Test-Group-471014642: created successfully
Jun 24 04:20:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b2d658b9-2fcd-4752-a227-f4565df3bb0e tempest-GroupsV320Test-1722298524 None] Create group completed successfully.
Jun 24 04:20:24 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b 1073741824" returned: 0 in 1.005s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:24 devstack sudo[103035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b
Jun 24 04:20:24 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:24 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8" returned: 0 in 0.882s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:24 devstack sudo[103037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8
Jun 24 04:20:24 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:24 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" returned: 0 in 0.666s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65333d95-821e-4110-a070-34c6d08769fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22882e42-a701-48c1-a682-34d7f0018d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:24 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Volume volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b (2cdfda09-8281-41ef-a0a0-d1d2b6dc665b): created successfully
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22882e42-a701-48c1-a682-34d7f0018d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Flow 'volume_create_manager' (7a2a213c-94a5-48ea-91d6-6f72d3e8ba0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:24 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6ee02ec9-c2d3-4bfe-bff5-bf04854e2aa4 tempest-GroupSnapshotsTest-2145445898 None] Created volume successfully.
Jun 24 04:20:25 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96cc158-adad-46fd-91e9-21f1fd787ac8" returned: 0 in 0.722s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-quobyte-d96cc158-adad-46fd-91e9-21f1fd787ac8" released by "delete_volume" :: held 1.697s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Created reservations ['788191c9-da36-4b7a-82a8-2d5be903aa08', 'd4c19b1b-0f73-4f3c-9321-55e70dea55d6', '7f397bc4-8c9c-46fb-ba99-b503e0dd91fd', 'd2d346fd-e636-4bc9-9631-1c214411b234'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:25 devstack sudo[103041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:20:25 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Created reservations ['581f4d44-4fea-4381-9ee6-37514b453f33'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:25 devstack sudo[103044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:20:25 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:25 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] GroupSnapshot 9cc62589-0588-4af5-9de5-400689243b04: creating.
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Group snapshot 9cc62589-0588-4af5-9de5-400689243b04: creating. {{(pid=93470) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Creating offline snapshot 3d5adeb6-970d-4cbd-85d0-63aed62a3aac of volume 2cdfda09-8281-41ef-a0a0-d1d2b6dc665b {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acc653d-194f-471f-b612-a18d19dc4097]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:26 devstack sudo[103046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b
Jun 24 04:20:26 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:26 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.914s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:26 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Deleted volume successfully.
Jun 24 04:20:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba497f0e-fb88-4309-b9e8-f0eac23e681b tempest-VolumesSnapshotNegativeTestJSON-1732039114 None] Lock "cinder-d96cc158-adad-46fd-91e9-21f1fd787ac8-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:26 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.816s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:26 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b98c8eaa-48da-4376-8e2e-4c117b19cfcd tempest-GroupsV320Test-1722298524 None] Delete group completed successfully.
Jun 24 04:20:26 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" returned: 0 in 1.041s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:26 devstack sudo[103054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac 1G
Jun 24 04:20:26 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:27 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac 1G" returned: 0 in 0.983s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:27 devstack sudo[103059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac
Jun 24 04:20:27 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:28 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac" returned: 0 in 0.968s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:28 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:20:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:28 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac
Jun 24 04:20:28 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:29 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac" returned: 0 in 0.913s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:29 devstack sudo[103087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.info
Jun 24 04:20:29 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:30 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.info" returned: 0 in 0.816s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:30 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:20:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:30 devstack sudo[103093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.info
Jun 24 04:20:30 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:31 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.info" returned: 0 in 0.774s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.614s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:31 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a39a9871-5666-4d35-a77c-826c0784dc7d tempest-GroupSnapshotsTest-2145445898 None] group_snapshot 9cc62589-0588-4af5-9de5-400689243b04: created successfully
Jun 24 04:20:32 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] group_snapshot 9cc62589-0588-4af5-9de5-400689243b04: deleting
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] group_snapshot 9cc62589-0588-4af5-9de5-400689243b04: deleting {{(pid=93470) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-3d5adeb6-970d-4cbd-85d0-63aed62a3aac" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-3d5adeb6-970d-4cbd-85d0-63aed62a3aac" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Deleting offline snapshot 3d5adeb6-970d-4cbd-85d0-63aed62a3aac of volume 2cdfda09-8281-41ef-a0a0-d1d2b6dc665b {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] snapshot_file for this snap is: volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1614c50-3ff6-443e-8d53-46781d9697c1]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:32 devstack sudo[103096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac
Jun 24 04:20:32 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:33 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac" returned: 0 in 1.059s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:20:33 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1ded3-d447-488d-8b68-21aab25601a9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:33 devstack sudo[103101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b
Jun 24 04:20:33 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:34 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" returned: 0 in 1.004s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:34 devstack sudo[103111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac
Jun 24 04:20:34 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:35 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac" returned: 0 in 0.923s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:35 devstack sudo[103116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac
Jun 24 04:20:35 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:36 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b.3d5adeb6-970d-4cbd-85d0-63aed62a3aac" returned: 0 in 0.955s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-3d5adeb6-970d-4cbd-85d0-63aed62a3aac" released by "_delete_snapshot" :: held 4.151s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" released by "delete_snapshot" :: held 4.201s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:36 devstack cinder-volume[93470]: WARNING cinder.quota [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1518691395 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1518691395, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:20:36 devstack cinder-volume[93470]: WARNING cinder.quota [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1518691395 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1518691395, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:20:36 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['3d54e0e1-2f04-489c-a235-f762500115f4', 'eb07265a-604d-404f-a773-e19219db33a0', '420f0c25-0623-4985-bd58-0c98c459c884', '3e8b4d94-38ac-47e8-be52-88d36221297c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:36 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9b87ce8a-d6d1-440a-9bec-1db0211e265f tempest-GroupSnapshotsTest-2145445898 None] group_snapshot 9cc62589-0588-4af5-9de5-400689243b04: deleted successfully
Jun 24 04:20:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "cinder-quobyte-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" acquired by "delete_volume" :: waited 0.044s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dd6f2f-3ec8-430e-a267-ae5ad2037d93]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:38 devstack sudo[103196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b
Jun 24 04:20:38 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:39 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" returned: 0 in 1.720s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:39 devstack sudo[103206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b
Jun 24 04:20:39 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:40 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" returned: 0 in 1.199s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Lock "cinder-quobyte-2cdfda09-8281-41ef-a0a0-d1d2b6dc665b" released by "delete_volume" :: held 3.071s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:40 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['a7f17d0a-ca8c-4ccb-9d67-ba8b48d6e90b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:40 devstack cinder-volume[93470]: WARNING cinder.quota [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1518691395 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1518691395, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:20:40 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Created reservations ['03b0e9ff-ca04-44eb-9c8a-1f8c1817a949', '4e9ef2f0-5714-4afe-a175-5d70e4d75319', 'f90711ed-5cc4-43e4-adec-0242dccb7bb3', '6b0c62e8-4772-4874-8693-5e7e78f3e771'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:41 devstack sudo[103210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:20:41 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:42 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.118s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:42 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ea2679f1-230d-45ce-812c-b9e86b24bf0b tempest-GroupSnapshotsTest-2145445898 None] Delete group completed successfully.
Jun 24 04:20:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:20:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:45 devstack sudo[103215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:20:45 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:46 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.220s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:20:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:20:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:20:51 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=91,cinder:UPDATE=102,cinder:INSERT=19,cinder:DELETE=2 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:20:51 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=100,cinder:INSERT=32,cinder:UPDATE=100,cinder:DELETE=3 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:20:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-11decfd0-91c1-400b-b130-b8935abbe00b tempest-GroupSnapshotsV319Test-1341614479 None] Group tempest-GroupSnapshotsV319Test-Group-430250533: creating
Jun 24 04:20:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-11decfd0-91c1-400b-b130-b8935abbe00b tempest-GroupSnapshotsV319Test-1341614479 None] Group tempest-GroupSnapshotsV319Test-Group-430250533: created successfully
Jun 24 04:20:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-11decfd0-91c1-400b-b130-b8935abbe00b tempest-GroupSnapshotsV319Test-1341614479 None] Create group completed successfully.
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Flow 'volume_create_manager' (b2d33816-082d-41bc-985e-3c47ba6059e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7224372-0a04-4fdf-8585-ad2e60433157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7224372-0a04-4fdf-8585-ad2e60433157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1324946235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e0fd6e7a-4653-4719-8722-1af166bb5645,host='devstack@QuobyteHD#QuobyteHD',id=98da05e9-53a7-471c-92e4-43fb8a568ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbf9ae43d9945b7b1bd26bd455d197a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:54Z,use_quota=True,user_id='2bf62555099b4f469022bf78f0e9b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc6373c9-621d-455a-ba15-ba9466e760dc),volume_type_id=cc6373c9-621d-455a-ba15-ba9466e760dc)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e86afb6-2aae-4d9d-bb62-acc1719d38c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e86afb6-2aae-4d9d-bb62-acc1719d38c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce6dfca-7d35-4511-9a3b-2e0e5ab81b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce6dfca-7d35-4511-9a3b-2e0e5ab81b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98da05e9-53a7-471c-92e4-43fb8a568ea1', 'volume_name': 'volume-98da05e9-53a7-471c-92e4-43fb8a568ea1', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a04b8e-961d-4eef-a036-e3c013f8dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a04b8e-961d-4eef-a036-e3c013f8dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a4cf46-67a9-4ff1-b29d-44a145d88cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:53 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Volume 98da05e9-53a7-471c-92e4-43fb8a568ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98da05e9-53a7-471c-92e4-43fb8a568ea1', 'volume_size': 1}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e0fd6e7a-4653-4719-8722-1af166bb5645,created_at=2026-06-24T02:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1324946235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e0fd6e7a-4653-4719-8722-1af166bb5645,host='devstack@QuobyteHD#QuobyteHD',id=98da05e9-53a7-471c-92e4-43fb8a568ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbf9ae43d9945b7b1bd26bd455d197a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:54Z,use_quota=True,user_id='2bf62555099b4f469022bf78f0e9b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc6373c9-621d-455a-ba15-ba9466e760dc),volume_type_id=cc6373c9-621d-455a-ba15-ba9466e760dc)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Creating volume 98da05e9-53a7-471c-92e4-43fb8a568ea1 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:20:53 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:20:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:53 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 1073741824
Jun 24 04:20:53 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:55 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 1073741824" returned: 0 in 1.301s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:55 devstack sudo[103250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1
Jun 24 04:20:55 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:56 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1" returned: 0 in 0.903s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:20:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a4cf46-67a9-4ff1-b29d-44a145d88cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98da05e9-53a7-471c-92e4-43fb8a568ea1', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d77ded-0ac8-4edd-864b-a6ae5a4003b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:56 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Volume volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 (98da05e9-53a7-471c-92e4-43fb8a568ea1): created successfully
Jun 24 04:20:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d77ded-0ac8-4edd-864b-a6ae5a4003b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Flow 'volume_create_manager' (b2d33816-082d-41bc-985e-3c47ba6059e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3cbce2cd-175e-435f-803c-eebfa1029450 tempest-GroupSnapshotsV319Test-1341614479 None] Created volume successfully.
Jun 24 04:20:57 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] GroupSnapshot 89cf1ec8-ab41-47f1-bfcf-4674f9bb30c4: creating.
Jun 24 04:20:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Group snapshot 89cf1ec8-ab41-47f1-bfcf-4674f9bb30c4: creating. {{(pid=93470) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 24 04:20:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Creating offline snapshot c266076e-147b-4e0b-9dfc-10d710e2b8e5 of volume 98da05e9-53a7-471c-92e4-43fb8a568ea1 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:20:57 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[20714a01-ccf3-4c6c-ae45-9c2d79f9f2e2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:57 devstack sudo[103258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1
Jun 24 04:20:57 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:58 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1" returned: 0 in 0.875s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:58 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 1G
Jun 24 04:20:58 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:59 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 1G" returned: 0 in 0.982s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:59 devstack sudo[103269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5
Jun 24 04:20:59 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:00 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5" returned: 0 in 1.039s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:00 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:21:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:00 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5
Jun 24 04:21:00 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:01 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5" returned: 0 in 0.838s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Flow 'volume_create_manager' (5b48c4c8-ba90-40d9-a17e-59dc3d186505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a20e2e-8452-4fec-a42b-0ed5fa260aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a20e2e-8452-4fec-a42b-0ed5fa260aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1202408479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297150f5-067c-457b-adb9-120befe1c128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa665077bf6f430da44f7874de60f142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:01Z,use_quota=True,user_id='18e623f3731546fea4254726a14603b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07199c52-b15e-4019-91c8-72be4c08db97),volume_type_id=07199c52-b15e-4019-91c8-72be4c08db97)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3811de-db2e-4224-abb5-363cf025730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3811de-db2e-4224-abb5-363cf025730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229e0b1e-abdd-463a-ba05-a6bce6988af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229e0b1e-abdd-463a-ba05-a6bce6988af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297150f5-067c-457b-adb9-120befe1c128', 'volume_name': 'volume-297150f5-067c-457b-adb9-120befe1c128', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e48fee9-6646-4bd2-a233-fad4972577bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e48fee9-6646-4bd2-a233-fad4972577bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c860126b-7605-4fdc-b042-4549461ebd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:01 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume 297150f5-067c-457b-adb9-120befe1c128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297150f5-067c-457b-adb9-120befe1c128', 'volume_size': 1}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:01 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.info
Jun 24 04:21:01 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Flow 'volume_create_manager' (ffad810d-dbdb-4aec-b706-e73e4e8e1330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95b6691-e873-4ea7-89dc-835a6e31e850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95b6691-e873-4ea7-89dc-835a6e31e850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-971309706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa665077bf6f430da44f7874de60f142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:02Z,use_quota=True,user_id='18e623f3731546fea4254726a14603b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d166f4a9-8b67-4599-af6d-f8f8af0170cd),volume_type_id=d166f4a9-8b67-4599-af6d-f8f8af0170cd)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45d6ffa-91fd-415d-939a-a440666da797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45d6ffa-91fd-415d-939a-a440666da797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b835944-5413-42a6-a178-06c8cd609c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b835944-5413-42a6-a178-06c8cd609c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd', 'volume_name': 'volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6166bbd1-3c39-456d-9039-5c8bc44cd837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6166bbd1-3c39-456d-9039-5c8bc44cd837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d0e85c-bc40-4ab8-a0b0-f95c187f6e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:02 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume 8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd', 'volume_size': 1}
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:02 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.info" returned: 0 in 0.958s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:02 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:21:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:02 devstack sudo[103283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.info
Jun 24 04:21:02 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:03 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.info" returned: 0 in 0.716s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.589s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.704s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1202408479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297150f5-067c-457b-adb9-120befe1c128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa665077bf6f430da44f7874de60f142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:01Z,use_quota=True,user_id='18e623f3731546fea4254726a14603b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07199c52-b15e-4019-91c8-72be4c08db97),volume_type_id=07199c52-b15e-4019-91c8-72be4c08db97)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Creating volume 297150f5-067c-457b-adb9-120befe1c128 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:03 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:03 devstack sudo[103286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128 1073741824
Jun 24 04:21:03 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Flow 'volume_create_manager' (0157fad8-8399-4c7b-aa8b-8f2654e032f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82893317-57dc-4d51-8e65-ce8edeb859c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-29afa915-776f-4546-a395-c7dfccd49588 tempest-GroupSnapshotsV319Test-1341614479 None] group_snapshot 89cf1ec8-ab41-47f1-bfcf-4674f9bb30c4: created successfully
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82893317-57dc-4d51-8e65-ce8edeb859c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-933205596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96396f7-3111-4d26-a078-ff58e027f84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa665077bf6f430da44f7874de60f142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:03Z,use_quota=True,user_id='18e623f3731546fea4254726a14603b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(156fedc4-cb9d-4aa6-8e10-66b0eb7dfa5c),volume_type_id=156fedc4-cb9d-4aa6-8e10-66b0eb7dfa5c)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5937c787-0b35-4bba-9998-c99ae7fe78ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5937c787-0b35-4bba-9998-c99ae7fe78ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c095484e-e62f-4a13-ad9f-fa143e78df55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Flow 'volume_create_manager' (60914d67-2930-4895-8bca-e25d101ad800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbcd6a2-f27a-4eba-93be-4a257ae55fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbcd6a2-f27a-4eba-93be-4a257ae55fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1669715089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598dc612-4080-45c6-b22c-3bc5d2b91f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca956a18b194ebb881516f06e91fce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:04Z,use_quota=True,user_id='97c38d4f240640039a1cb7115250a55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c218c3-20b3-4f72-b2ed-c356c44d2a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c218c3-20b3-4f72-b2ed-c356c44d2a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbb3f50-f206-46ae-b514-0a8ded316466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbb3f50-f206-46ae-b514-0a8ded316466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598dc612-4080-45c6-b22c-3bc5d2b91f12', 'volume_name': 'volume-598dc612-4080-45c6-b22c-3bc5d2b91f12', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76c9dbb-ee7d-4b37-ae4d-cf0f7c03c3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76c9dbb-ee7d-4b37-ae4d-cf0f7c03c3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5c90f5-c421-4d7f-905f-084cb410caf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Volume 598dc612-4080-45c6-b22c-3bc5d2b91f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598dc612-4080-45c6-b22c-3bc5d2b91f12', 'volume_size': 1}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c095484e-e62f-4a13-ad9f-fa143e78df55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd96396f7-3111-4d26-a078-ff58e027f84b', 'volume_name': 'volume-d96396f7-3111-4d26-a078-ff58e027f84b', 'volume_size': 1, 'image_id': 'e0266653-82a9-4bd5-8344-7563a03ce81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0266653-82a9-4bd5-8344-7563a03ce81a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--533511689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa665077bf6f430da44f7874de60f142', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0266653-82a9-4bd5-8344-7563a03ce81a', 'created_at': datetime.datetime(2026, 6, 24, 2, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0266653-82a9-4bd5-8344-7563a03ce81a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76de9cd0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582649bc-8e2d-4823-9062-ca4f5194a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582649bc-8e2d-4823-9062-ca4f5194a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c696ef-5bb4-4b20-8810-a54a9ce80218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:03 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume d96396f7-3111-4d26-a078-ff58e027f84b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d96396f7-3111-4d26-a078-ff58e027f84b', 'volume_size': 1, 'image_id': 'e0266653-82a9-4bd5-8344-7563a03ce81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0266653-82a9-4bd5-8344-7563a03ce81a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--533511689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa665077bf6f430da44f7874de60f142', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0266653-82a9-4bd5-8344-7563a03ce81a', 'created_at': datetime.datetime(2026, 6, 24, 2, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0266653-82a9-4bd5-8344-7563a03ce81a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76de9cd0>}
Jun 24 04:21:03 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Trying to clone d96396f7-3111-4d26-a078-ff58e027f84b from image e0266653-82a9-4bd5-8344-7563a03ce81a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e0266653-82a9-4bd5-8344-7563a03ce81a', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Flow 'volume_create_manager' (03d5daf9-d1d6-41f0-8424-e9477e4655db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26d5f98-9288-49f2-9262-c1fd50db4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26d5f98-9288-49f2-9262-c1fd50db4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-531994557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938da82a-5ebd-4ecb-878a-caf250d28b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58cd96d582a47dcbf9b6a13c23af7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:04Z,use_quota=True,user_id='3881077525d34140a5874ee54ad6c2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bddbc1-1b52-4729-a59a-a8a9591df90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bddbc1-1b52-4729-a59a-a8a9591df90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:04 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b7dadc-e0f0-460f-864e-1f7ef27b7fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b7dadc-e0f0-460f-864e-1f7ef27b7fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938da82a-5ebd-4ecb-878a-caf250d28b43', 'volume_name': 'volume-938da82a-5ebd-4ecb-878a-caf250d28b43', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e86d6a-f757-4c86-808d-8e408a6dfe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e86d6a-f757-4c86-808d-8e408a6dfe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cac2e13-c546-4a51-a8dd-566a9fdcc95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:04 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Volume 938da82a-5ebd-4ecb-878a-caf250d28b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938da82a-5ebd-4ecb-878a-caf250d28b43', 'volume_size': 1}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128 1073741824" returned: 0 in 1.182s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:04 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128
Jun 24 04:21:04 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] group_snapshot 89cf1ec8-ab41-47f1-bfcf-4674f9bb30c4: deleting
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] group_snapshot 89cf1ec8-ab41-47f1-bfcf-4674f9bb30c4: deleting {{(pid=93470) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Acquiring lock "cinder-quobyte-98da05e9-53a7-471c-92e4-43fb8a568ea1" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "cinder-quobyte-98da05e9-53a7-471c-92e4-43fb8a568ea1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Acquiring lock "cinder-quobyte-c266076e-147b-4e0b-9dfc-10d710e2b8e5" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "cinder-quobyte-c266076e-147b-4e0b-9dfc-10d710e2b8e5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Deleting offline snapshot c266076e-147b-4e0b-9dfc-10d710e2b8e5 of volume 98da05e9-53a7-471c-92e4-43fb8a568ea1 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] snapshot_file for this snap is: volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd5e6f2-5e4a-440f-a410-18e9e162a171]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:04 devstack sudo[103296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5
Jun 24 04:21:04 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:05 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128" returned: 0 in 0.772s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.865s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-971309706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa665077bf6f430da44f7874de60f142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:02Z,use_quota=True,user_id='18e623f3731546fea4254726a14603b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d166f4a9-8b67-4599-af6d-f8f8af0170cd),volume_type_id=d166f4a9-8b67-4599-af6d-f8f8af0170cd)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Creating volume 8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:05 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c860126b-7605-4fdc-b042-4549461ebd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297150f5-067c-457b-adb9-120befe1c128', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:05 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd 1073741824
Jun 24 04:21:05 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b291a175-cc2c-4d93-9662-c2cfb4271d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:05 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume volume-297150f5-067c-457b-adb9-120befe1c128 (297150f5-067c-457b-adb9-120befe1c128): created successfully
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b291a175-cc2c-4d93-9662-c2cfb4271d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Flow 'volume_create_manager' (5b48c4c8-ba90-40d9-a17e-59dc3d186505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:05 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3f9ed2ac-cb12-4bcb-b67a-9b938d3a47f4 tempest-TestInstancesWithCinderVolumes-130270379 None] Created volume successfully.
Jun 24 04:21:05 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5" returned: 0 in 0.825s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98da05e9-53a7-471c-92e4-43fb8a568ea1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e565a99-ef28-475d-a5a4-7c06fc7da0d8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:05 devstack sudo[103307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1
Jun 24 04:21:05 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:06 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd 1073741824" returned: 0 in 0.864s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:06 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd
Jun 24 04:21:06 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:06 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1" returned: 0 in 0.856s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:06 devstack sudo[103319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5
Jun 24 04:21:06 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:06 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd" returned: 0 in 0.679s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.125s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1669715089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598dc612-4080-45c6-b22c-3bc5d2b91f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca956a18b194ebb881516f06e91fce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:04Z,use_quota=True,user_id='97c38d4f240640039a1cb7115250a55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Creating volume 598dc612-4080-45c6-b22c-3bc5d2b91f12 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:06 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:06 devstack sudo[103322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12 1073741824
Jun 24 04:21:06 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d0e85c-bc40-4ab8-a0b0-f95c187f6e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36afbe5-2778-48bc-a9b5-6eae798c5530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:06 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd (8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd): created successfully
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36afbe5-2778-48bc-a9b5-6eae798c5530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Flow 'volume_create_manager' (ffad810d-dbdb-4aec-b706-e73e4e8e1330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:07 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-89b9344d-a154-492a-9065-d11fdadfe623 tempest-TestInstancesWithCinderVolumes-130270379 None] Created volume successfully.
Jun 24 04:21:07 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5" returned: 0 in 0.785s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:07 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5
Jun 24 04:21:07 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:07 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD, size 20.69 MB, duration 3.73 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:21:07 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Image download 20.69 MB at 5.54 MB/s
Jun 24 04:21:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3aac88-e15e-423f-bd65-7e65c46a3ca9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:07 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12 1073741824" returned: 0 in 0.874s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:07 devstack sudo[103333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD
Jun 24 04:21:07 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:07 devstack sudo[103335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12
Jun 24 04:21:07 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:07 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1.c266076e-147b-4e0b-9dfc-10d710e2b8e5" returned: 0 in 0.698s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "cinder-quobyte-c266076e-147b-4e0b-9dfc-10d710e2b8e5" released by "_delete_snapshot" :: held 3.287s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "cinder-quobyte-98da05e9-53a7-471c-92e4-43fb8a568ea1" released by "delete_snapshot" :: held 3.315s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:08 devstack cinder-volume[93470]: WARNING cinder.quota [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1675137111 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1675137111, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:21:08 devstack cinder-volume[93470]: WARNING cinder.quota [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1675137111 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1675137111, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] Created reservations ['0fe72434-a7eb-415d-8753-cc2484f47359', '895d99fc-0402-4afe-87c3-f297a4398af0', '949186b0-d661-4bdc-b75c-180db1a2e2ae', '89bcf0dd-0695-4762-b3b2-7175b5bb14f3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-7d169a45-404b-4b4e-96a3-526d285c0d28 tempest-GroupSnapshotsV319Test-1341614479 None] group_snapshot 89cf1ec8-ab41-47f1-bfcf-4674f9bb30c4: deleted successfully
Jun 24 04:21:08 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Temporary image e0266653-82a9-4bd5-8344-7563a03ce81a is fetched for user 18e623f3731546fea4254726a14603b5. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:21:08 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12" returned: 0 in 0.642s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.025s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-531994557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938da82a-5ebd-4ecb-878a-caf250d28b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58cd96d582a47dcbf9b6a13c23af7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:04Z,use_quota=True,user_id='3881077525d34140a5874ee54ad6c2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Creating volume 938da82a-5ebd-4ecb-878a-caf250d28b43 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:08 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:08 devstack sudo[103342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43 1073741824
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5c90f5-c421-4d7f-905f-084cb410caf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598dc612-4080-45c6-b22c-3bc5d2b91f12', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:08 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40affdab-3d19-492b-aebe-e9885519a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[544dd4dd-9b2a-4f53-9e25-28e35dd85f70]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:08 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Volume volume-598dc612-4080-45c6-b22c-3bc5d2b91f12 (598dc612-4080-45c6-b22c-3bc5d2b91f12): created successfully
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40affdab-3d19-492b-aebe-e9885519a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Flow 'volume_create_manager' (60914d67-2930-4895-8bca-e25d101ad800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3dd7d058-8951-4816-94ec-2ead49552af9 tempest-VolumesListAdminTestJSON-1212678 None] Created volume successfully.
Jun 24 04:21:08 devstack sudo[103344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD
Jun 24 04:21:08 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:09 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Acquiring lock "cinder-quobyte-98da05e9-53a7-471c-92e4-43fb8a568ea1" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "cinder-quobyte-98da05e9-53a7-471c-92e4-43fb8a568ea1" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:09 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43 1073741824" returned: 0 in 0.945s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad446ea-4486-4b22-8995-00756cee1d34]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:09 devstack sudo[103355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43
Jun 24 04:21:09 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Flow 'volume_create_manager' (daab861f-1c0b-4019-8f8a-9ed80f70fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a0624a-ce2a-4c64-8884-5b12ee5191c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:09 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1
Jun 24 04:21:09 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a0624a-ce2a-4c64-8884-5b12ee5191c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1014491558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b3264f-23aa-4373-b7fc-e3130e12f729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca956a18b194ebb881516f06e91fce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:10Z,use_quota=True,user_id='97c38d4f240640039a1cb7115250a55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a08d100-223f-45b8-94ea-24308c3f0bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a08d100-223f-45b8-94ea-24308c3f0bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740f0d7b-b5bb-4285-b545-6b6207bd3236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740f0d7b-b5bb-4285-b545-6b6207bd3236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b3264f-23aa-4373-b7fc-e3130e12f729', 'volume_name': 'volume-c4b3264f-23aa-4373-b7fc-e3130e12f729', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa68beba-c6c1-4d6d-9607-b10b6e40a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa68beba-c6c1-4d6d-9607-b10b6e40a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a8e343-b4fa-4d76-b4b1-38744130898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:09 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Volume c4b3264f-23aa-4373-b7fc-e3130e12f729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b3264f-23aa-4373-b7fc-e3130e12f729', 'volume_size': 1}
Jun 24 04:21:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:10 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43" returned: 0 in 0.682s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-933205596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96396f7-3111-4d26-a078-ff58e027f84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa665077bf6f430da44f7874de60f142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:03Z,use_quota=True,user_id='18e623f3731546fea4254726a14603b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(156fedc4-cb9d-4aa6-8e10-66b0eb7dfa5c),volume_type_id=156fedc4-cb9d-4aa6-8e10-66b0eb7dfa5c)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Creating volume d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:10 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:10 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b 1073741824
Jun 24 04:21:10 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cac2e13-c546-4a51-a8dd-566a9fdcc95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938da82a-5ebd-4ecb-878a-caf250d28b43', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5819108d-59d2-4b2b-b2c3-61948fcf24bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:10 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1" returned: 0 in 0.796s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:10 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1
Jun 24 04:21:10 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:10 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Volume volume-938da82a-5ebd-4ecb-878a-caf250d28b43 (938da82a-5ebd-4ecb-878a-caf250d28b43): created successfully
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5819108d-59d2-4b2b-b2c3-61948fcf24bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Flow 'volume_create_manager' (03d5daf9-d1d6-41f0-8424-e9477e4655db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ed5077f5-7059-4bc8-8258-37814c240060 tempest-AttachVolumeNegativeTest-596704228 None] Created volume successfully.
Jun 24 04:21:11 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-98da05e9-53a7-471c-92e4-43fb8a568ea1" returned: 0 in 0.835s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "cinder-quobyte-98da05e9-53a7-471c-92e4-43fb8a568ea1" released by "delete_volume" :: held 1.705s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:11 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b 1073741824" returned: 0 in 0.962s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Created reservations ['4724fb7b-ab28-413d-baf2-0defe255276d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:11 devstack sudo[103411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:21:11 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:11 devstack cinder-volume[93470]: WARNING cinder.quota [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1675137111 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1675137111, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Created reservations ['68666bc5-37eb-4066-8d90-d07cf5d405d4', '060bfd16-8424-4d13-95da-78306b8ce585', 'c39abc4f-9989-41cd-9c9f-52d6a583df98', 'ebbc1491-e7f4-4dba-b83d-3164fba702ed'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:11 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:21:11 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:11 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 0 in 0.662s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1014491558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b3264f-23aa-4373-b7fc-e3130e12f729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca956a18b194ebb881516f06e91fce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:10Z,use_quota=True,user_id='97c38d4f240640039a1cb7115250a55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Creating volume c4b3264f-23aa-4373-b7fc-e3130e12f729 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:11 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:11 devstack sudo[103417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729 1073741824
Jun 24 04:21:11 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:11 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Attempting download of e0266653-82a9-4bd5-8344-7563a03ce81a ((None, [{'url': 'file:///opt/stack/data/glance/images/e0266653-82a9-4bd5-8344-7563a03ce81a', 'metadata': {}}])) to volume d96396f7-3111-4d26-a078-ff58e027f84b. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:21:12 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2b8c21-148d-4690-a229-48a693ecb085]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0266653-82a9-4bd5-8344-7563a03ce81a_4dy3wjpp {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:12 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.737s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:12 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:12 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3bbb1e96-4b2b-4474-982e-d5b58a2793e0 tempest-GroupSnapshotsV319Test-1341614479 None] Delete group completed successfully.
Jun 24 04:21:12 devstack sudo[103420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0266653-82a9-4bd5-8344-7563a03ce81a_4dy3wjpp
Jun 24 04:21:12 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:12 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0266653-82a9-4bd5-8344-7563a03ce81a_4dy3wjpp" returned: 0 in 0.765s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0266653-82a9-4bd5-8344-7563a03ce81a_4dy3wjpp {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:12 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729 1073741824" returned: 0 in 0.958s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:12 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0266653-82a9-4bd5-8344-7563a03ce81a_4dy3wjpp
Jun 24 04:21:12 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:12 devstack sudo[103429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729
Jun 24 04:21:12 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:13 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0266653-82a9-4bd5-8344-7563a03ce81a_4dy3wjpp" returned: 1 in 0.813s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0266653-82a9-4bd5-8344-7563a03ce81a_4dy3wjpp' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1067774-8ef5-4af0-997d-a2fa4a22b76c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:13 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729" returned: 0 in 0.798s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a8e343-b4fa-4d76-b4b1-38744130898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b3264f-23aa-4373-b7fc-e3130e12f729', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b290ae-8303-4056-850c-248560d25a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:13 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Volume volume-c4b3264f-23aa-4373-b7fc-e3130e12f729 (c4b3264f-23aa-4373-b7fc-e3130e12f729): created successfully
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b290ae-8303-4056-850c-248560d25a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:13 devstack sudo[103435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD
Jun 24 04:21:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Flow 'volume_create_manager' (daab861f-1c0b-4019-8f8a-9ed80f70fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:13 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:13 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ab9cffcb-1665-4231-b2bb-2d62f0731195 tempest-VolumesListAdminTestJSON-1212678 None] Created volume successfully.
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-7e834ef5-5997-4c12-bb8b-85fedf869013 req-7a8e1487-a69b-42a6-aee2-550c40afe980 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-7e834ef5-5997-4c12-bb8b-85fedf869013 req-7a8e1487-a69b-42a6-aee2-550c40afe980 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de27797-60ac-47ce-a3e1-789dd3f721a5]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-7e834ef5-5997-4c12-bb8b-85fedf869013 req-7a8e1487-a69b-42a6-aee2-550c40afe980 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:14 devstack sudo[103446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43
Jun 24 04:21:14 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:14 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD" returned: 0 in 0.904s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] e0266653-82a9-4bd5-8344-7563a03ce81a was qcow2, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:14 devstack sudo[103452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:21:14 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:14 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-7e834ef5-5997-4c12-bb8b-85fedf869013 req-7a8e1487-a69b-42a6-aee2-550c40afe980 tempest-AttachVolumeNegativeTest-596704228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43" returned: 0 in 0.890s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-7e834ef5-5997-4c12-bb8b-85fedf869013 req-7a8e1487-a69b-42a6-aee2-550c40afe980 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-7e834ef5-5997-4c12-bb8b-85fedf869013 req-7a8e1487-a69b-42a6-aee2-550c40afe980 tempest-AttachVolumeNegativeTest-596704228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-938da82a-5ebd-4ecb-878a-caf250d28b43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9390179c-4fa8-4e96-b5db-4940c1cb4f74', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:21:15 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-7e834ef5-5997-4c12-bb8b-85fedf869013 req-7a8e1487-a69b-42a6-aee2-550c40afe980 tempest-AttachVolumeNegativeTest-596704228 None] attachment_update completed successfully.
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Flow 'volume_create_manager' (1b6f0e2c-ebb8-44f4-8290-29c8adaaac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea36bcf-a898-4df6-9e7b-cfe68992b4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea36bcf-a898-4df6-9e7b-cfe68992b4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-360620647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf477587-318d-4ee0-af54-48231c47acc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca956a18b194ebb881516f06e91fce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:15Z,use_quota=True,user_id='97c38d4f240640039a1cb7115250a55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48c35d6-cedb-4247-9ceb-99a9ecfd417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48c35d6-cedb-4247-9ceb-99a9ecfd417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c1c8cd-42f0-4396-b0f8-de24f055a939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c1c8cd-42f0-4396-b0f8-de24f055a939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf477587-318d-4ee0-af54-48231c47acc8', 'volume_name': 'volume-bf477587-318d-4ee0-af54-48231c47acc8', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b11f914-039c-460a-a0cd-d599faa33cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b11f914-039c-460a-a0cd-d599faa33cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b4d680-5865-45ba-b68e-89340ff1da7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:15 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Volume bf477587-318d-4ee0-af54-48231c47acc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf477587-318d-4ee0-af54-48231c47acc8', 'volume_size': 1}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-360620647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf477587-318d-4ee0-af54-48231c47acc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca956a18b194ebb881516f06e91fce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:15Z,use_quota=True,user_id='97c38d4f240640039a1cb7115250a55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Creating volume bf477587-318d-4ee0-af54-48231c47acc8 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:15 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:15 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8 1073741824
Jun 24 04:21:15 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:16 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8 1073741824" returned: 0 in 1.079s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:16 devstack sudo[103863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8
Jun 24 04:21:16 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:17 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 0 in 2.580s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e0266653-82a9-4bd5-8344-7563a03ce81a_mipe43kgdevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:21:17 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Converted 112.00 MB image at 43.37 MB/s
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:17 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b 1G
Jun 24 04:21:17 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:17 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8" returned: 0 in 0.721s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b4d680-5865-45ba-b68e-89340ff1da7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf477587-318d-4ee0-af54-48231c47acc8', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070e1d44-593a-407d-84e1-47e7856eb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Volume volume-bf477587-318d-4ee0-af54-48231c47acc8 (bf477587-318d-4ee0-af54-48231c47acc8): created successfully
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070e1d44-593a-407d-84e1-47e7856eb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Flow 'volume_create_manager' (1b6f0e2c-ebb8-44f4-8290-29c8adaaac68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:17 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3d36dbcf-4a16-477c-a554-3644c1117557 tempest-VolumesListAdminTestJSON-1212678 None] Created volume successfully.
Jun 24 04:21:17 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b 1G" returned: 0 in 0.714s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cbe077-f8b6-4195-947e-64ce6a307f9c]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:17 devstack sudo[103872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:21:17 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Flow 'volume_create_manager' (62f3db4a-b57d-44c3-bc8b-d9d5278b2c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2441b80-1962-469f-b7b2-fd1dc8b72219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2441b80-1962-469f-b7b2-fd1dc8b72219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-476566283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e50198-b4b7-4578-9fae-114e67ba13f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ddf2a95973b446e9219505283761a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:18Z,use_quota=True,user_id='bd72212662e14c56a76358b84a48d27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01db9fd9-6af8-4761-bf32-a67caf71f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01db9fd9-6af8-4761-bf32-a67caf71f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58318e00-8959-438f-a0e5-39381e535715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58318e00-8959-438f-a0e5-39381e535715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e50198-b4b7-4578-9fae-114e67ba13f0', 'volume_name': 'volume-96e50198-b4b7-4578-9fae-114e67ba13f0', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2114f0-b320-49e3-bcf6-2bc9ed57e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2114f0-b320-49e3-bcf6-2bc9ed57e175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80fc641-9466-41d9-af5e-1a3cee2746de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:18 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Volume 96e50198-b4b7-4578-9fae-114e67ba13f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e50198-b4b7-4578-9fae-114e67ba13f0', 'volume_size': 1}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-476566283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e50198-b4b7-4578-9fae-114e67ba13f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ddf2a95973b446e9219505283761a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:18Z,use_quota=True,user_id='bd72212662e14c56a76358b84a48d27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Creating volume 96e50198-b4b7-4578-9fae-114e67ba13f0 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:18 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:18 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0 1073741824
Jun 24 04:21:18 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:18 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 0 in 0.786s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:18 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:21:18 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:19 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0 1073741824" returned: 0 in 0.965s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:19 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 1 in 0.814s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Downloaded image e0266653-82a9-4bd5-8344-7563a03ce81a ((None, [{'url': 'file:///opt/stack/data/glance/images/e0266653-82a9-4bd5-8344-7563a03ce81a', 'metadata': {}}])) to volume d96396f7-3111-4d26-a078-ff58e027f84b successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Temporary image e0266653-82a9-4bd5-8344-7563a03ce81a for user 18e623f3731546fea4254726a14603b5 is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Marking volume d96396f7-3111-4d26-a078-ff58e027f84b as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Copying metadata from image e0266653-82a9-4bd5-8344-7563a03ce81a to d96396f7-3111-4d26-a078-ff58e027f84b. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Creating volume glance metadata for volume d96396f7-3111-4d26-a078-ff58e027f84b backed by image e0266653-82a9-4bd5-8344-7563a03ce81a with: {'image_id': 'e0266653-82a9-4bd5-8344-7563a03ce81a', 'image_name': 'tempest-scenario-img--533511689', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:19 devstack sudo[103888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0
Jun 24 04:21:19 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Flow 'volume_create_manager' (d620711e-d543-4688-8237-b83f593ad9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624588c0-fa4c-4044-8676-e2df0456a5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624588c0-fa4c-4044-8676-e2df0456a5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a80786a-3152-47ca-92dc-2ae3e1afd831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6287fabb6941bfbe5bebd5695a44a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:19Z,use_quota=True,user_id='68fbd79a7e2f44e4bdebbc70dfdddc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f2f875-7fdc-4362-b0c7-00c84138a147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f2f875-7fdc-4362-b0c7-00c84138a147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5578cc4-71a6-4eb4-87ee-5bc76c185f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5578cc4-71a6-4eb4-87ee-5bc76c185f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a80786a-3152-47ca-92dc-2ae3e1afd831', 'volume_name': 'volume-3a80786a-3152-47ca-92dc-2ae3e1afd831', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553536eb-66ca-4028-aee4-39a9c4c4ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553536eb-66ca-4028-aee4-39a9c4c4ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed47a93-dcfc-473c-afa3-f3e88843a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:19 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Volume 3a80786a-3152-47ca-92dc-2ae3e1afd831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a80786a-3152-47ca-92dc-2ae3e1afd831', 'volume_size': 1}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c696ef-5bb4-4b20-8810-a54a9ce80218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96396f7-3111-4d26-a078-ff58e027f84b', 'volume_size': 1, 'image_id': 'e0266653-82a9-4bd5-8344-7563a03ce81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0266653-82a9-4bd5-8344-7563a03ce81a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--533511689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa665077bf6f430da44f7874de60f142', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0266653-82a9-4bd5-8344-7563a03ce81a', 'created_at': datetime.datetime(2026, 6, 24, 2, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0266653-82a9-4bd5-8344-7563a03ce81a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76de9cd0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cceb5777-84d5-4d90-a580-157b2468dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:19 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Volume volume-d96396f7-3111-4d26-a078-ff58e027f84b (d96396f7-3111-4d26-a078-ff58e027f84b): created successfully
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cceb5777-84d5-4d90-a580-157b2468dc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Flow 'volume_create_manager' (0157fad8-8399-4c7b-aa8b-8f2654e032f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:19 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b9f69245-9a01-4016-a6f1-d509dd9d26a8 tempest-TestInstancesWithCinderVolumes-130270379 None] Created volume successfully.
Jun 24 04:21:20 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0" returned: 0 in 0.668s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a80786a-3152-47ca-92dc-2ae3e1afd831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6287fabb6941bfbe5bebd5695a44a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:19Z,use_quota=True,user_id='68fbd79a7e2f44e4bdebbc70dfdddc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Creating volume 3a80786a-3152-47ca-92dc-2ae3e1afd831 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:20 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80fc641-9466-41d9-af5e-1a3cee2746de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e50198-b4b7-4578-9fae-114e67ba13f0', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:20 devstack sudo[103891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831 1073741824
Jun 24 04:21:20 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574392a8-199f-483a-86fc-a2c299d7f574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:20 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Volume volume-96e50198-b4b7-4578-9fae-114e67ba13f0 (96e50198-b4b7-4578-9fae-114e67ba13f0): created successfully
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574392a8-199f-483a-86fc-a2c299d7f574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Flow 'volume_create_manager' (62f3db4a-b57d-44c3-bc8b-d9d5278b2c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:20 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-11c3d7a2-dc72-4c7b-85ec-f9f9a0370db6 tempest-VolumesServicesTestJSON-568534446 None] Created volume successfully.
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Acquiring lock "cinder-96e50198-b4b7-4578-9fae-114e67ba13f0-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Lock "cinder-96e50198-b4b7-4578-9fae-114e67ba13f0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Acquiring lock "cinder-quobyte-96e50198-b4b7-4578-9fae-114e67ba13f0" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Lock "cinder-quobyte-96e50198-b4b7-4578-9fae-114e67ba13f0" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6b04e1-af51-4724-9487-5fa3cb69a2fb]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:20 devstack sudo[103896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0
Jun 24 04:21:20 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:21 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831 1073741824" returned: 0 in 0.963s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:21 devstack sudo[103900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831
Jun 24 04:21:21 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:21 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0" returned: 0 in 0.820s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:21 devstack sudo[103905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0
Jun 24 04:21:21 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:21 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831" returned: 0 in 0.816s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed47a93-dcfc-473c-afa3-f3e88843a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a80786a-3152-47ca-92dc-2ae3e1afd831', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f5b56f-ba9c-460b-b278-3fcf5cafc1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:22 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Volume volume-3a80786a-3152-47ca-92dc-2ae3e1afd831 (3a80786a-3152-47ca-92dc-2ae3e1afd831): created successfully
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f5b56f-ba9c-460b-b278-3fcf5cafc1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Flow 'volume_create_manager' (d620711e-d543-4688-8237-b83f593ad9dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c89e35cc-3bc5-4bc5-b859-a2d4ed0f540f tempest-VolumesListAdminTestJSON-757880155 None] Created volume successfully.
Jun 24 04:21:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-d202c1a2-05ac-4b0b-9507-5cdcf1b7f1c9 req-c899fef7-c52f-4f83-bbaa-0f3f6da92834 tempest-AttachVolumeNegativeTest-596704228 None] Terminate volume connection completed successfully.
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-d202c1a2-05ac-4b0b-9507-5cdcf1b7f1c9 req-c899fef7-c52f-4f83-bbaa-0f3f6da92834 tempest-AttachVolumeNegativeTest-596704228 None] Deleting attachment 9390179c-4fa8-4e96-b5db-4940c1cb4f74. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:21:22 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-96e50198-b4b7-4578-9fae-114e67ba13f0" returned: 0 in 0.829s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Lock "cinder-quobyte-96e50198-b4b7-4578-9fae-114e67ba13f0" released by "delete_volume" :: held 1.701s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Created reservations ['9b12da66-2d6d-4115-b859-603129501b2c', 'db70fe3e-2d59-485a-bddd-4f3a74d6e3d5', 'a983f3fd-8b40-46d8-a1bb-7f3f5bf034b0', '76673d29-4e2f-4fba-9e11-1c59f244a3b3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:22 devstack sudo[103943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:21:22 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Acquiring lock "cinder-3a80786a-3152-47ca-92dc-2ae3e1afd831-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Lock "cinder-3a80786a-3152-47ca-92dc-2ae3e1afd831-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Acquiring lock "cinder-quobyte-3a80786a-3152-47ca-92dc-2ae3e1afd831" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Lock "cinder-quobyte-3a80786a-3152-47ca-92dc-2ae3e1afd831" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce11c2d-4523-45f8-8154-b2cfe4f982d8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "cinder-bf477587-318d-4ee0-af54-48231c47acc8-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-bf477587-318d-4ee0-af54-48231c47acc8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "cinder-quobyte-bf477587-318d-4ee0-af54-48231c47acc8" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-quobyte-bf477587-318d-4ee0-af54-48231c47acc8" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:23 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[566f8a5d-3777-49ca-89d2-d3eddea5ac8c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:23 devstack sudo[103945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831
Jun 24 04:21:23 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:23 devstack sudo[103946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8
Jun 24 04:21:23 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:23 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.904s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:23 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Deleted volume successfully.
Jun 24 04:21:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e0a0acc5-6e98-452a-87f9-e01a19564c9a tempest-VolumesServicesTestJSON-568534446 None] Lock "cinder-96e50198-b4b7-4578-9fae-114e67ba13f0-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:24 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831" returned: 0 in 1.196s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:24 devstack sudo[103957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831
Jun 24 04:21:24 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:24 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8" returned: 0 in 1.089s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:24 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8
Jun 24 04:21:24 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:24 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf477587-318d-4ee0-af54-48231c47acc8" returned: 0 in 0.800s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-quobyte-bf477587-318d-4ee0-af54-48231c47acc8" released by "delete_volume" :: held 1.950s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:25 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3a80786a-3152-47ca-92dc-2ae3e1afd831" returned: 0 in 0.892s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Lock "cinder-quobyte-3a80786a-3152-47ca-92dc-2ae3e1afd831" released by "delete_volume" :: held 2.162s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Created reservations ['af4dee9a-caad-4032-bca3-e7bcca9d6a22', '9edcc463-013d-4103-abab-fabd652f8361', 'f1b58ea0-868b-4877-a820-8f987acb85d3', '2cf40e3a-1403-498c-aeb6-677ce4d629fe'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Created reservations ['8f341867-0045-4485-b83e-2410a518edca', 'c8aee298-ec58-4b71-ab70-c63077345282', 'bb7d1aff-a9d7-443f-832c-6b30bc3119c8', '02327edb-d4b8-46f6-a0ee-abec9982b951'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:25 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:21:25 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "cinder-c4b3264f-23aa-4373-b7fc-e3130e12f729-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:25 devstack sudo[103991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:21:25 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-c4b3264f-23aa-4373-b7fc-e3130e12f729-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "cinder-quobyte-c4b3264f-23aa-4373-b7fc-e3130e12f729" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-quobyte-c4b3264f-23aa-4373-b7fc-e3130e12f729" acquired by "delete_volume" :: waited 0.041s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188d97f-afcc-4714-a72e-31c6162daef3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:25 devstack sudo[104007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729
Jun 24 04:21:25 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:26 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.348s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:26 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:26 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Deleted volume successfully.
Jun 24 04:21:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.160s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:26 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Deleted volume successfully.
Jun 24 04:21:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c4cd3c69-db86-416e-bf9b-5aadffec1572 tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-bf477587-318d-4ee0-af54-48231c47acc8-delete_volume" released by "delete_volume" :: held 3.683s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d108808d-e798-4b86-95f3-ae408b6b4090 tempest-VolumesListAdminTestJSON-757880155 None] Lock "cinder-3a80786a-3152-47ca-92dc-2ae3e1afd831-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:26 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729" returned: 0 in 1.224s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:27 devstack sudo[104016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729
Jun 24 04:21:27 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:28 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c4b3264f-23aa-4373-b7fc-e3130e12f729" returned: 0 in 1.032s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-quobyte-c4b3264f-23aa-4373-b7fc-e3130e12f729" released by "delete_volume" :: held 2.399s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Created reservations ['13ee2a21-98bc-4c70-961a-8319032640ee', '94c648b7-f50a-4f18-a10f-065f8c65dc11', '0eb30e1a-d507-4175-8143-40aed1f19fb5', '6a25b604-ca24-4efc-9374-5ce03cb91331'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:28 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:21:28 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab1d0cd-27ea-455f-8525-f8cfeed18dfd]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:28 devstack sudo[104030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:21:28 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "cinder-598dc612-4080-45c6-b22c-3bc5d2b91f12-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-598dc612-4080-45c6-b22c-3bc5d2b91f12-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "cinder-quobyte-598dc612-4080-45c6-b22c-3bc5d2b91f12" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-quobyte-598dc612-4080-45c6-b22c-3bc5d2b91f12" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[564e4076-10ea-46e9-93de-b7300470120c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:29 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.097s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:29 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Deleted volume successfully.
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-05a00e0c-6c1b-49c1-ad2f-7beb0d81452d tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-c4b3264f-23aa-4373-b7fc-e3130e12f729-delete_volume" released by "delete_volume" :: held 3.845s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:29 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12
Jun 24 04:21:29 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:29 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 0 in 1.159s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:29 devstack sudo[104038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:21:29 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:30 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12" returned: 0 in 1.001s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:30 devstack sudo[104044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12
Jun 24 04:21:30 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:30 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 1 in 1.008s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:21:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.225s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-d96396f7-3111-4d26-a078-ff58e027f84b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e3384d4-7a8d-4fbd-b866-d3c935eab508', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:21:30 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-89c52d5b-820e-489d-ac2e-d5550412accd req-b2f732b9-f8d6-4cb3-9fe7-8f12b7f4eb17 tempest-TestInstancesWithCinderVolumes-130270379 None] attachment_update completed successfully.
Jun 24 04:21:31 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-598dc612-4080-45c6-b22c-3bc5d2b91f12" returned: 0 in 0.810s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-quobyte-598dc612-4080-45c6-b22c-3bc5d2b91f12" released by "delete_volume" :: held 1.876s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Created reservations ['32acd2e0-243b-4123-9945-ae0c244f2aaf', 'f828cde6-08bc-4a32-8346-acbce9f37f58', 'c32fb5fe-bb16-4b18-96e3-d4d69e5002bb', '0fe06e61-411e-4d65-a9f5-0f7efc3ca9d0'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:31 devstack sudo[104050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:21:31 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:32 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.983s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:32 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:32 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Deleted volume successfully.
Jun 24 04:21:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0853c58b-dfb6-4850-a469-25b3afcb364e tempest-VolumesListAdminTestJSON-1212678 None] Lock "cinder-598dc612-4080-45c6-b22c-3bc5d2b91f12-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:41 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=78,cinder:UPDATE=94,cinder:DELETE=7,cinder:INSERT=22 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=92,cinder:UPDATE=95,cinder:INSERT=27,cinder:DELETE=8 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Flow 'volume_create_manager' (811ce4a3-cd05-4dcc-af64-bfc1e4be11f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61e0046-5065-476c-b4b3-d87022a3df59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61e0046-5065-476c-b4b3-d87022a3df59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1783040953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199cdf93-44da-4a42-aeef-0ebf03a7bc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d13280fbd4d18bab47095b6cc525e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:42Z,use_quota=True,user_id='f486fff33a3e449a9923bb9f8c39943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936decc6-5824-4052-94ae-08df95afa688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936decc6-5824-4052-94ae-08df95afa688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b846e2a9-feec-4341-b913-0610c4913a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b846e2a9-feec-4341-b913-0610c4913a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199cdf93-44da-4a42-aeef-0ebf03a7bc88', 'volume_name': 'volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7db772-e1c6-442d-bdc5-82d9d59346d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7db772-e1c6-442d-bdc5-82d9d59346d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7aa9c03-cdfb-4d38-8f0a-47996eca8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:42 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Volume 199cdf93-44da-4a42-aeef-0ebf03a7bc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88', 'volume_size': 1}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1783040953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199cdf93-44da-4a42-aeef-0ebf03a7bc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d13280fbd4d18bab47095b6cc525e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:42Z,use_quota=True,user_id='f486fff33a3e449a9923bb9f8c39943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Creating volume 199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:42 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:42 devstack sudo[104520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 1073741824
Jun 24 04:21:42 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:44 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 1073741824" returned: 0 in 1.449s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:44 devstack sudo[104526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88
Jun 24 04:21:44 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Flow 'volume_create_manager' (6fe8db7a-efce-4115-b976-ce558e62a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b633af-f261-4cf8-afd2-f0f80d92abe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b633af-f261-4cf8-afd2-f0f80d92abe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1932866480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e102506d-b00f-4a6a-b11c-ac41f549cec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21fe22bf34ca4ca2ac51c2a1ab715a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:45Z,use_quota=True,user_id='fff612da831f41f991a06c92e28b4a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a390b4-a50a-4f41-acd3-817ac592a9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a390b4-a50a-4f41-acd3-817ac592a9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccc11ce-d288-4801-8651-2e16de47618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:44 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccc11ce-d288-4801-8651-2e16de47618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e102506d-b00f-4a6a-b11c-ac41f549cec4', 'volume_name': 'volume-e102506d-b00f-4a6a-b11c-ac41f549cec4', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb6c9811c0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9125499-7cc8-418b-ae1e-bb46ab269ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9125499-7cc8-418b-ae1e-bb46ab269ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e711f38-7df7-4475-88d7-39747fcdf9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:45 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Volume e102506d-b00f-4a6a-b11c-ac41f549cec4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e102506d-b00f-4a6a-b11c-ac41f549cec4', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb6c9811c0>}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Trying to clone e102506d-b00f-4a6a-b11c-ac41f549cec4 from image 1fe711f9-301b-47ca-8464-f7cda30438a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:45 devstack sudo[104531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:21:45 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:45 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88" returned: 0 in 1.607s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] <== create_volume: return (3150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.158s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7aa9c03-cdfb-4d38-8f0a-47996eca8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9db1cb-3fcf-41be-af8e-1fc3d1d4a267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:45 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Volume volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 (199cdf93-44da-4a42-aeef-0ebf03a7bc88): created successfully
Jun 24 04:21:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9db1cb-3fcf-41be-af8e-1fc3d1d4a267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Flow 'volume_create_manager' (811ce4a3-cd05-4dcc-af64-bfc1e4be11f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:46 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:21:46 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Image download 20.69 MB at 20.69 MB/s
Jun 24 04:21:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0cb45f13-e97b-4789-b5d3-b43711249447 tempest-VolumesDeleteCascade-470049609 None] Created volume successfully.
Jun 24 04:21:46 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b2a0c4-19ce-4e93-b700-079c7fdce08b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:46 devstack sudo[104535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD
Jun 24 04:21:46 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:47 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.814s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Creating offline snapshot 5701938a-133d-416c-823c-e4280817f213 of volume 199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b0596a-d5d1-4226-ad8d-6202605d5a55]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:47 devstack sudo[104541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88
Jun 24 04:21:47 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:47 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD" returned: 0 in 1.707s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:47 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Temporary image 1fe711f9-301b-47ca-8464-f7cda30438a4 is fetched for user fff612da831f41f991a06c92e28b4a30. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:21:48 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3177441f-5a48-47a8-bb76-e516f2034942]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:48 devstack sudo[104556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD
Jun 24 04:21:48 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:49 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88" returned: 0 in 1.648s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:49 devstack sudo[104564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 1G
Jun 24 04:21:49 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:49 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD" returned: 0 in 1.362s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:50 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 1G" returned: 0 in 1.285s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:50 devstack sudo[104575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213
Jun 24 04:21:50 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:51 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213" returned: 0 in 0.960s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:51 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 is being set with open permissions: ugo+rw
Jun 24 04:21:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:51 devstack sudo[104580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213
Jun 24 04:21:51 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:52 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213" returned: 0 in 0.828s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:52 devstack sudo[104583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.info
Jun 24 04:21:52 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:53 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.info" returned: 0 in 0.903s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:53 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.info is being set with open permissions: ugo+rw
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:53 devstack sudo[104611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.info
Jun 24 04:21:53 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:53 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.info" returned: 0 in 0.749s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.509s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.405s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1932866480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e102506d-b00f-4a6a-b11c-ac41f549cec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21fe22bf34ca4ca2ac51c2a1ab715a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:45Z,use_quota=True,user_id='fff612da831f41f991a06c92e28b4a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Creating volume e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:53 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:21:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:53 devstack sudo[104618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 1073741824
Jun 24 04:21:53 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-374707a0-1595-4648-8a74-cfa08e83b9dc tempest-VolumesDeleteCascade-470049609 None] Create snapshot completed successfully
Jun 24 04:21:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:55 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 1073741824" returned: 0 in 1.131s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:55 devstack sudo[104715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4
Jun 24 04:21:55 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:55 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4" returned: 0 in 0.698s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.852s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Creating offline snapshot 5066189a-e763-4468-bf52-11f1954f8fcd of volume 199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46842ab-7185-45f2-a676-b5ce10919dad]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Attempting download of 1fe711f9-301b-47ca-8464-f7cda30438a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}])) to volume e102506d-b00f-4a6a-b11c-ac41f549cec4. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[84989124-0ae9-48ed-ac76-cf20205902a0]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_lzqxemdv {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:55 devstack sudo[104733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213
Jun 24 04:21:55 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:56 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_lzqxemdv
Jun 24 04:21:56 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:57 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213" returned: 0 in 1.317s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:21:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:57 devstack sudo[104806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd 1G
Jun 24 04:21:57 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:57 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_lzqxemdv" returned: 0 in 1.344s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_lzqxemdv {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:57 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_lzqxemdv
Jun 24 04:21:57 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:58 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_lzqxemdv" returned: 1 in 0.934s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_lzqxemdv' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:21:58 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:58 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8db9d92-f6b6-4fcc-b36b-f426fd2788f9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd 1G" returned: 0 in 1.055s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:58 devstack sudo[104828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd
Jun 24 04:21:58 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:58 devstack sudo[104827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD
Jun 24 04:21:58 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:59 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD" returned: 0 in 0.936s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:59 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] 1fe711f9-301b-47ca-8464-f7cda30438a4 was qcow2, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:21:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:59 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4
Jun 24 04:21:59 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:59 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd" returned: 0 in 1.082s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:59 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd is being set with open permissions: ugo+rw
Jun 24 04:21:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:59 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd
Jun 24 04:21:59 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:00 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd" returned: 0 in 0.806s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.413s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f7ce6efa-1efc-486f-9af5-4a20e6f3b93a tempest-VolumesDeleteCascade-470049609 None] Create snapshot completed successfully
Jun 24 04:22:01 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4" returned: 0 in 2.243s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_zcuc2igldevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:22:01 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Converted 112.00 MB image at 49.86 MB/s
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:01 devstack sudo[104851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 1G
Jun 24 04:22:01 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-199cdf93-44da-4a42-aeef-0ebf03a7bc88-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-199cdf93-44da-4a42-aeef-0ebf03a7bc88-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Performing cascade delete. {{(pid=93470) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-5066189a-e763-4468-bf52-11f1954f8fcd-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-5066189a-e763-4468-bf52-11f1954f8fcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-5066189a-e763-4468-bf52-11f1954f8fcd" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-5066189a-e763-4468-bf52-11f1954f8fcd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Deleting offline snapshot 5066189a-e763-4468-bf52-11f1954f8fcd of volume 199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] snapshot_file for this snap is: volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff27eed6-1dce-45b3-aa36-e20e9ae361e1]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:02 devstack sudo[104853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd
Jun 24 04:22:02 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:02 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 1G" returned: 0 in 1.143s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:02 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc08c64-c48e-4587-a040-6597bd2d2dbe]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:02 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4
Jun 24 04:22:02 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:03 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd" returned: 0 in 1.322s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:22:03 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5e0139-0601-44c9-aead-7e74c348952f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:03 devstack sudo[104865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213
Jun 24 04:22:03 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:03 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4" returned: 0 in 1.069s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:03 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4
Jun 24 04:22:03 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:04 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213" returned: 0 in 1.071s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:04 devstack sudo[104880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd
Jun 24 04:22:04 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:04 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4" returned: 1 in 1.142s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Downloaded image 1fe711f9-301b-47ca-8464-f7cda30438a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}])) to volume e102506d-b00f-4a6a-b11c-ac41f549cec4 successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Temporary image 1fe711f9-301b-47ca-8464-f7cda30438a4 for user fff612da831f41f991a06c92e28b4a30 is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Marking volume e102506d-b00f-4a6a-b11c-ac41f549cec4 as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Copying metadata from image 1fe711f9-301b-47ca-8464-f7cda30438a4 to e102506d-b00f-4a6a-b11c-ac41f549cec4. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Creating volume glance metadata for volume e102506d-b00f-4a6a-b11c-ac41f549cec4 backed by image 1fe711f9-301b-47ca-8464-f7cda30438a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e711f38-7df7-4475-88d7-39747fcdf9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e102506d-b00f-4a6a-b11c-ac41f549cec4', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb6c9811c0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49da956-35e1-4a63-b3af-3d397c777f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:04 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Volume volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 (e102506d-b00f-4a6a-b11c-ac41f549cec4): created successfully
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49da956-35e1-4a63-b3af-3d397c777f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Flow 'volume_create_manager' (6fe8db7a-efce-4115-b976-ce558e62a957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:05 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-bd93bee8-d58a-42b7-b986-4b7b788ccaa9 tempest-VolumesImageMetadata-928764292 None] Created volume successfully.
Jun 24 04:22:05 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd" returned: 0 in 0.993s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:05 devstack sudo[104894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd
Jun 24 04:22:05 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:06 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5066189a-e763-4468-bf52-11f1954f8fcd" returned: 0 in 0.741s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-5066189a-e763-4468-bf52-11f1954f8fcd" released by "_delete_snapshot" :: held 4.272s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" released by "delete_snapshot" :: held 4.312s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Created reservations ['c9a00249-6a64-4642-a5fb-8067c91ed606', '606fb490-0467-4231-b183-237044958c06', 'cdf40373-50c3-44b0-9736-4a87668da2ca', '3e19f33c-113a-43ed-b5cb-7e4a72fb76d3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Acquiring lock "cinder-e102506d-b00f-4a6a-b11c-ac41f549cec4-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Delete snapshot completed successfully.
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-5066189a-e763-4468-bf52-11f1954f8fcd-delete_snapshot" released by "delete_snapshot" :: held 4.539s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-5701938a-133d-416c-823c-e4280817f213-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Lock "cinder-e102506d-b00f-4a6a-b11c-ac41f549cec4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-5701938a-133d-416c-823c-e4280817f213-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-5701938a-133d-416c-823c-e4280817f213" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Acquiring lock "cinder-quobyte-e102506d-b00f-4a6a-b11c-ac41f549cec4" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-5701938a-133d-416c-823c-e4280817f213" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Deleting offline snapshot 5701938a-133d-416c-823c-e4280817f213 of volume 199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] snapshot_file for this snap is: volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Lock "cinder-quobyte-e102506d-b00f-4a6a-b11c-ac41f549cec4" acquired by "delete_volume" :: waited 0.044s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43df4a8-2cd2-45a5-9a07-aa6002d3d405]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ce85cb-0360-4237-9943-96f0c54eb528]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:06 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213
Jun 24 04:22:06 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:06 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4
Jun 24 04:22:06 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:07 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:07 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4" returned: 0 in 0.853s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213" returned: 0 in 0.913s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3f51f3-7fe2-438d-8198-182c9d62e944]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:07 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4
Jun 24 04:22:07 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:07 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88
Jun 24 04:22:07 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-200956fc-873b-4236-92e6-0e607773bbd4 req-9d13ed5a-4471-4ab7-93f6-f99ec1fd64d3 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-200956fc-873b-4236-92e6-0e607773bbd4 req-9d13ed5a-4471-4ab7-93f6-f99ec1fd64d3 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31bf2fe-db00-4bd6-a233-6122943a1b9e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-200956fc-873b-4236-92e6-0e607773bbd4 req-9d13ed5a-4471-4ab7-93f6-f99ec1fd64d3 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:07 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128
Jun 24 04:22:07 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:08 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4" returned: 1 in 0.891s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:08 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4
Jun 24 04:22:08 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:08 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88" returned: 0 in 1.085s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:08 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213
Jun 24 04:22:08 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:08 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-200956fc-873b-4236-92e6-0e607773bbd4 req-9d13ed5a-4471-4ab7-93f6-f99ec1fd64d3 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128" returned: 0 in 0.911s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-200956fc-873b-4236-92e6-0e607773bbd4 req-9d13ed5a-4471-4ab7-93f6-f99ec1fd64d3 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-200956fc-873b-4236-92e6-0e607773bbd4 req-9d13ed5a-4471-4ab7-93f6-f99ec1fd64d3 tempest-TestInstancesWithCinderVolumes-130270379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-297150f5-067c-457b-adb9-120befe1c128', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab9cd521-d8d0-42d5-8989-1db22169ad4d', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:22:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-200956fc-873b-4236-92e6-0e607773bbd4 req-9d13ed5a-4471-4ab7-93f6-f99ec1fd64d3 tempest-TestInstancesWithCinderVolumes-130270379 None] attachment_update completed successfully.
Jun 24 04:22:08 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e102506d-b00f-4a6a-b11c-ac41f549cec4" returned: 0 in 0.777s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Lock "cinder-quobyte-e102506d-b00f-4a6a-b11c-ac41f549cec4" released by "delete_volume" :: held 2.606s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Created reservations ['3934c00a-7ed3-4142-8fe8-fda029ad64b6', 'fdf59618-2601-435d-ae53-c97416928f7b', 'b69047c7-dd96-4c4a-8c1d-59c6d6a80605', 'a590c5ea-db78-4bd4-ac94-9e7623b6ca7b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:09 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:09 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:09 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213" returned: 0 in 0.934s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:09 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213
Jun 24 04:22:09 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:10 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.901s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Deleted volume successfully.
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-87b1512f-8a79-43a8-8e77-3083bd02f4a5 tempest-VolumesImageMetadata-928764292 None] Lock "cinder-e102506d-b00f-4a6a-b11c-ac41f549cec4-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:10 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88.5701938a-133d-416c-823c-e4280817f213" returned: 0 in 0.869s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-5701938a-133d-416c-823c-e4280817f213" released by "_delete_snapshot" :: held 3.923s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" released by "delete_snapshot" :: held 3.963s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Created reservations ['372c1a15-bf6f-4c68-8469-802d737372e7', '7d03f730-bc71-432d-aefb-4fd93f038106', '491632f2-4d0d-44fe-a64f-bcabc8ff3f5e', '45cb2ab8-8574-43dd-ba30-ce906505781d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Delete snapshot completed successfully.
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-5701938a-133d-416c-823c-e4280817f213-delete_snapshot" released by "delete_snapshot" :: held 4.206s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Snapshots deleted, issuing volume delete {{(pid=93470) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" acquired by "delete_volume" :: waited 0.013s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c15d2d-ecac-418f-b769-d742e1c0d60e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:10 devstack sudo[104975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88
Jun 24 04:22:10 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:11 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88" returned: 0 in 0.890s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:11 devstack sudo[105016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88
Jun 24 04:22:11 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:12 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-199cdf93-44da-4a42-aeef-0ebf03a7bc88" returned: 0 in 0.758s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-199cdf93-44da-4a42-aeef-0ebf03a7bc88" released by "delete_volume" :: held 1.708s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Created reservations ['172041ce-f304-45c2-a97c-551de2d69f15', 'c07a9797-52da-4b85-8374-8ac4d9fae56f', '31faaeed-dd1c-4b38-b41b-9906538a1333', '1cf0bc20-f4ef-4bd3-a986-b550498af788'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:12 devstack sudo[105021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:12 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:13 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.766s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:13 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Deleted volume successfully.
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-257cdef8-1d33-4e77-9735-e5e5a6782882 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-199cdf93-44da-4a42-aeef-0ebf03a7bc88-delete_volume" released by "delete_volume" :: held 11.574s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Flow 'volume_create_manager' (ce74f87c-0c90-4e32-b89f-fdae37cb881b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756cbcd7-a7d0-4b58-9157-1cf8415f27cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756cbcd7-a7d0-4b58-9157-1cf8415f27cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2030599997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57130efa-d192-4117-97a9-041491f81be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d13280fbd4d18bab47095b6cc525e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:13Z,use_quota=True,user_id='f486fff33a3e449a9923bb9f8c39943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7841da9-146f-46e5-ae80-72d3232f2260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7841da9-146f-46e5-ae80-72d3232f2260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a74478f-7aed-40e0-bb2c-402864e8275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a74478f-7aed-40e0-bb2c-402864e8275b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57130efa-d192-4117-97a9-041491f81be4', 'volume_name': 'volume-57130efa-d192-4117-97a9-041491f81be4', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0152ae2-b4b3-4a2e-864f-4cb7ee0eff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0152ae2-b4b3-4a2e-864f-4cb7ee0eff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4fa629-c877-49d6-85e6-eacd45401d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:13 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Volume 57130efa-d192-4117-97a9-041491f81be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57130efa-d192-4117-97a9-041491f81be4', 'volume_size': 1}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2030599997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57130efa-d192-4117-97a9-041491f81be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d13280fbd4d18bab47095b6cc525e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:13Z,use_quota=True,user_id='f486fff33a3e449a9923bb9f8c39943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Creating volume 57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:13 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:13 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 1073741824
Jun 24 04:22:13 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:14 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 1073741824" returned: 0 in 0.961s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:14 devstack sudo[105036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4
Jun 24 04:22:14 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Flow 'volume_create_manager' (814038c9-daf3-4606-9f70-235d0bf8e647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979ac971-bbc7-43e4-ac16-b92e8d895969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979ac971-bbc7-43e4-ac16-b92e8d895969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-992679696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663221b8-9498-4dad-95a8-fa1bd0507bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caca63626f9147bd816718d03d41dda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:15Z,use_quota=True,user_id='7f04bfc9908b4ec9825770316654a082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430d6da2-e4e6-43e9-b4d3-a97c6bbe10c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430d6da2-e4e6-43e9-b4d3-a97c6bbe10c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b721f8-2d4d-48d7-b1a2-f40593a8f459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b721f8-2d4d-48d7-b1a2-f40593a8f459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663221b8-9498-4dad-95a8-fa1bd0507bfe', 'volume_name': 'volume-663221b8-9498-4dad-95a8-fa1bd0507bfe', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f5f3b0-5a01-45bb-881d-27a187a20b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f5f3b0-5a01-45bb-881d-27a187a20b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87fffb9-d113-4634-96a7-1804f25a7822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:14 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Volume 663221b8-9498-4dad-95a8-fa1bd0507bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663221b8-9498-4dad-95a8-fa1bd0507bfe', 'volume_size': 1}
Jun 24 04:22:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:15 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4" returned: 0 in 0.714s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-992679696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663221b8-9498-4dad-95a8-fa1bd0507bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caca63626f9147bd816718d03d41dda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:15Z,use_quota=True,user_id='7f04bfc9908b4ec9825770316654a082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Creating volume 663221b8-9498-4dad-95a8-fa1bd0507bfe {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:15 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4fa629-c877-49d6-85e6-eacd45401d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57130efa-d192-4117-97a9-041491f81be4', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:15 devstack sudo[105042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe 1073741824
Jun 24 04:22:15 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20f9d7f-98b9-430a-90d6-d286504be355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:15 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Volume volume-57130efa-d192-4117-97a9-041491f81be4 (57130efa-d192-4117-97a9-041491f81be4): created successfully
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20f9d7f-98b9-430a-90d6-d286504be355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Flow 'volume_create_manager' (ce74f87c-0c90-4e32-b89f-fdae37cb881b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:15 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-024d5141-bf3c-44e6-8128-8461f27f8cef tempest-VolumesDeleteCascade-470049609 None] Created volume successfully.
Jun 24 04:22:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:16 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe 1073741824" returned: 0 in 0.834s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:16 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe
Jun 24 04:22:16 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:16 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe" returned: 0 in 0.667s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.206s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Creating offline snapshot d7fd18a1-5f78-449f-8d0d-86721fcc2b28 of volume 57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87fffb9-d113-4634-96a7-1804f25a7822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663221b8-9498-4dad-95a8-fa1bd0507bfe', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a4a35e-1f1d-4f8e-b2c6-077f53f71631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedc6ae8-ce87-4e81-b27e-69c7a2a8c4fe]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:16 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Volume volume-663221b8-9498-4dad-95a8-fa1bd0507bfe (663221b8-9498-4dad-95a8-fa1bd0507bfe): created successfully
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a4a35e-1f1d-4f8e-b2c6-077f53f71631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Flow 'volume_create_manager' (814038c9-daf3-4606-9f70-235d0bf8e647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:16 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-45baf1be-151d-465a-a451-b23e2998a0d6 tempest-VolumesTransfersTest-109370086 None] Created volume successfully.
Jun 24 04:22:16 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4
Jun 24 04:22:16 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-21f996d2-98c3-425c-80cd-c84426ed62fd req-0e8a8dc4-5da9-4635-84ea-68139681e1c9 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:17 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4" returned: 0 in 0.848s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:17 devstack sudo[105065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 1G
Jun 24 04:22:17 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:18 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 1G" returned: 0 in 0.909s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57130efa-d192-4117-97a9-041491f81be4 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:18 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57130efa-d192-4117-97a9-041491f81be4 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28
Jun 24 04:22:18 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:18 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2253d714-0b4c-4ef5-b180-297fdc7e9dba tempest-VolumesTransfersTest-720824847 None] Transfer volume completed successfully.
Jun 24 04:22:19 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57130efa-d192-4117-97a9-041491f81be4 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28" returned: 0 in 0.730s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:19 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 is being set with open permissions: ugo+rw
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:19 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28
Jun 24 04:22:19 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Acquiring lock "cinder-663221b8-9498-4dad-95a8-fa1bd0507bfe-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Lock "cinder-663221b8-9498-4dad-95a8-fa1bd0507bfe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Acquiring lock "cinder-quobyte-663221b8-9498-4dad-95a8-fa1bd0507bfe" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Lock "cinder-quobyte-663221b8-9498-4dad-95a8-fa1bd0507bfe" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa9795-b416-4309-90f8-2d383f52eda8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:19 devstack sudo[105078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe
Jun 24 04:22:19 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:19 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28" returned: 0 in 0.684s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:20 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.info
Jun 24 04:22:20 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:20 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe" returned: 0 in 0.782s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:20 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe
Jun 24 04:22:20 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:20 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.info" returned: 0 in 0.653s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:20 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.info is being set with open permissions: ugo+rw
Jun 24 04:22:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:20 devstack sudo[105089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.info
Jun 24 04:22:20 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:21 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-663221b8-9498-4dad-95a8-fa1bd0507bfe" returned: 0 in 0.658s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Lock "cinder-quobyte-663221b8-9498-4dad-95a8-fa1bd0507bfe" released by "delete_volume" :: held 1.490s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Created reservations ['73926e48-a932-47e1-8ef3-4a517dafe7c1', 'bb232d4a-48e0-4593-8320-1dfe92067b4c', 'a7247ae5-4026-4049-befc-254b4a717636', 'f03e1578-7bd9-4fa5-a12d-3fbe3c4f8264'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:21 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.info" returned: 0 in 0.677s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:21 devstack sudo[105093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:21 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.625s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-21f996d2-98c3-425c-80cd-c84426ed62fd req-0e8a8dc4-5da9-4635-84ea-68139681e1c9 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.773s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[832e6db9-d7b6-4fae-a256-1a43e2be0aba]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-21f996d2-98c3-425c-80cd-c84426ed62fd req-0e8a8dc4-5da9-4635-84ea-68139681e1c9 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-00ef909a-48ff-4093-81fc-e1e9a0cbe543 tempest-VolumesDeleteCascade-470049609 None] Create snapshot completed successfully
Jun 24 04:22:21 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd
Jun 24 04:22:21 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:22 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.730s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Deleted volume successfully.
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cf8adb40-7fae-479c-bbcb-330d58bd5e33 tempest-VolumesTransfersTest-1067897528 None] Lock "cinder-663221b8-9498-4dad-95a8-fa1bd0507bfe-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:22 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-21f996d2-98c3-425c-80cd-c84426ed62fd req-0e8a8dc4-5da9-4635-84ea-68139681e1c9 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd" returned: 0 in 0.825s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-21f996d2-98c3-425c-80cd-c84426ed62fd req-0e8a8dc4-5da9-4635-84ea-68139681e1c9 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-21f996d2-98c3-425c-80cd-c84426ed62fd req-0e8a8dc4-5da9-4635-84ea-68139681e1c9 tempest-TestInstancesWithCinderVolumes-130270379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba5a73ba-cc4c-4e9f-9ae5-5c79582042da', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Flow 'volume_create_manager' (6d0215b7-12aa-4ad7-83e6-c71b4afba55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa62ce1-c61b-425d-9a3c-e6155ad25b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa62ce1-c61b-425d-9a3c-e6155ad25b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1287149337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3f97e4-0ce6-470f-8849-b5f64f314464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d13280fbd4d18bab47095b6cc525e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7fd18a1-5f78-449f-8d0d-86721fcc2b28,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:22Z,use_quota=True,user_id='f486fff33a3e449a9923bb9f8c39943d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3734ad-30fc-4810-93ae-0dd950b4b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3734ad-30fc-4810-93ae-0dd950b4b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1de2b2-5cb1-4ef5-9bc4-b8727c32c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1de2b2-5cb1-4ef5-9bc4-b8727c32c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd3f97e4-0ce6-470f-8849-b5f64f314464', 'volume_name': 'volume-dd3f97e4-0ce6-470f-8849-b5f64f314464', 'volume_size': 1, 'snapshot_id': 'd7fd18a1-5f78-449f-8d0d-86721fcc2b28'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb82f89-17f1-40aa-8702-6e592c1e530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb82f89-17f1-40aa-8702-6e592c1e530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452038f6-0964-4bce-93d7-d72ed3bf09f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Volume dd3f97e4-0ce6-470f-8849-b5f64f314464: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd3f97e4-0ce6-470f-8849-b5f64f314464', 'volume_size': 1, 'snapshot_id': 'd7fd18a1-5f78-449f-8d0d-86721fcc2b28'}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-d7fd18a1-5f78-449f-8d0d-86721fcc2b28-dd3f97e4-0ce6-470f-8849-b5f64f314464" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-d7fd18a1-5f78-449f-8d0d-86721fcc2b28-dd3f97e4-0ce6-470f-8849-b5f64f314464" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Creating volume dd3f97e4-0ce6-470f-8849-b5f64f314464 from snapshot d7fd18a1-5f78-449f-8d0d-86721fcc2b28 {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-dd3f97e4-0ce6-470f-8849-b5f64f314464" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-dd3f97e4-0ce6-470f-8849-b5f64f314464" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] snapshot: d7fd18a1-5f78-449f-8d0d-86721fcc2b28, volume: dd3f97e4-0ce6-470f-8849-b5f64f314464,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:22:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-21f996d2-98c3-425c-80cd-c84426ed62fd req-0e8a8dc4-5da9-4635-84ea-68139681e1c9 tempest-TestInstancesWithCinderVolumes-130270379 None] attachment_update completed successfully.
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5dd207-2b55-4537-a92f-b5a6fd319c93]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:22 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28
Jun 24 04:22:22 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Flow 'volume_create_manager' (5fba01f8-e34e-48f7-be2c-b2a5504f50bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d0f053-3294-4518-9083-a9577d4f3816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d0f053-3294-4518-9083-a9577d4f3816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-548324586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53700a8-1264-4239-80a2-d21887f33f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58cd96d582a47dcbf9b6a13c23af7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:23Z,use_quota=True,user_id='3881077525d34140a5874ee54ad6c2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f61f52-ca89-4597-88ee-b497ab3381cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f61f52-ca89-4597-88ee-b497ab3381cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae9812f-e74c-4b68-a506-42e21b8ef3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae9812f-e74c-4b68-a506-42e21b8ef3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53700a8-1264-4239-80a2-d21887f33f43', 'volume_name': 'volume-e53700a8-1264-4239-80a2-d21887f33f43', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd8d63b-a812-455b-ab47-6f29779b956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd8d63b-a812-455b-ab47-6f29779b956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550bd78f-36fa-4eb2-8d7d-f895aab46d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:22 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Volume e53700a8-1264-4239-80a2-d21887f33f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53700a8-1264-4239-80a2-d21887f33f43', 'volume_size': 1}
Jun 24 04:22:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Flow 'volume_create_manager' (f2051c28-f1ed-4333-a34f-8f702090fc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1c9d8e-4519-4f26-a5ea-2da637b64537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1c9d8e-4519-4f26-a5ea-2da637b64537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1165246237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86e3045-26b8-4947-b1e7-91cc4bd74e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caca63626f9147bd816718d03d41dda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:23Z,use_quota=True,user_id='7f04bfc9908b4ec9825770316654a082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae071d0b-7b86-47e1-a5c4-f6659777c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae071d0b-7b86-47e1-a5c4-f6659777c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c11d210-6bdd-4547-adf1-07ff1cc7ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c11d210-6bdd-4547-adf1-07ff1cc7ff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86e3045-26b8-4947-b1e7-91cc4bd74e94', 'volume_name': 'volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5eaf2a4-a70b-41a6-b1bc-223e7e22f1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5eaf2a4-a70b-41a6-b1bc-223e7e22f1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f03d3fc-1807-42ed-9206-47c0dab3805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:23 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Volume a86e3045-26b8-4947-b1e7-91cc4bd74e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94', 'volume_size': 1}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:23 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28" returned: 0 in 0.841s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57130efa-d192-4117-97a9-041491f81be4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7579fc88-0fa2-4af3-9b6e-502e45f0eef5]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:23 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4
Jun 24 04:22:23 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:24 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4" returned: 0 in 0.800s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:24 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464 not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:22:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:24 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464
Jun 24 04:22:24 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:29 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464" returned: 0 in 5.100s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:29 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[72afba50-188f-473f-af66-4713f30fa2ad]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:29 devstack sudo[105140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4
Jun 24 04:22:29 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:30 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4" returned: 0 in 0.991s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:22:30 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Converted 1024.00 MB image at 200.72 MB/s
Jun 24 04:22:30 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464 is being set with open permissions: ugo+rw
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:30 devstack sudo[105154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464
Jun 24 04:22:30 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:30 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464" returned: 0 in 0.658s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-dd3f97e4-0ce6-470f-8849-b5f64f314464" released by "_copy_volume_from_snapshot" :: held 8.502s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-d7fd18a1-5f78-449f-8d0d-86721fcc2b28-dd3f97e4-0ce6-470f-8849-b5f64f314464" released by "_create_volume_from_snapshot" :: held 8.542s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.563s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.180s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-548324586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53700a8-1264-4239-80a2-d21887f33f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58cd96d582a47dcbf9b6a13c23af7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:23Z,use_quota=True,user_id='3881077525d34140a5874ee54ad6c2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Creating volume e53700a8-1264-4239-80a2-d21887f33f43 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:30 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:30 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43 1073741824
Jun 24 04:22:30 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452038f6-0964-4bce-93d7-d72ed3bf09f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3f97e4-0ce6-470f-8849-b5f64f314464', 'volume_size': 1, 'snapshot_id': 'd7fd18a1-5f78-449f-8d0d-86721fcc2b28'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8cd2b4-cc7a-4c8f-8368-1b3dfb7043e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:31 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Volume volume-dd3f97e4-0ce6-470f-8849-b5f64f314464 (dd3f97e4-0ce6-470f-8849-b5f64f314464): created successfully
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8cd2b4-cc7a-4c8f-8368-1b3dfb7043e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Flow 'volume_create_manager' (6d0215b7-12aa-4ad7-83e6-c71b4afba55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:31 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-27a3a9dc-fc1d-4682-be55-8b064b2351f9 tempest-VolumesDeleteCascade-470049609 None] Created volume successfully.
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-57130efa-d192-4117-97a9-041491f81be4-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-57130efa-d192-4117-97a9-041491f81be4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Performing cascade delete. {{(pid=93470) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-d7fd18a1-5f78-449f-8d0d-86721fcc2b28-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-d7fd18a1-5f78-449f-8d0d-86721fcc2b28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-57130efa-d192-4117-97a9-041491f81be4" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-57130efa-d192-4117-97a9-041491f81be4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-d7fd18a1-5f78-449f-8d0d-86721fcc2b28" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-d7fd18a1-5f78-449f-8d0d-86721fcc2b28" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Deleting offline snapshot d7fd18a1-5f78-449f-8d0d-86721fcc2b28 of volume 57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] snapshot_file for this snap is: volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95e01d4-cde3-4693-bcda-75c7ae65a6d2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:31 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28
Jun 24 04:22:31 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:31 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43 1073741824" returned: 0 in 0.865s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:31 devstack sudo[105179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43
Jun 24 04:22:31 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:32 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28" returned: 0 in 0.794s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57130efa-d192-4117-97a9-041491f81be4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b30874-3918-4c3a-a174-7f920e98c8c1]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:32 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43" returned: 0 in 0.716s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.324s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1165246237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86e3045-26b8-4947-b1e7-91cc4bd74e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caca63626f9147bd816718d03d41dda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:23Z,use_quota=True,user_id='7f04bfc9908b4ec9825770316654a082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Creating volume a86e3045-26b8-4947-b1e7-91cc4bd74e94 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:32 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:32 devstack sudo[105185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4
Jun 24 04:22:32 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:32 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94 1073741824
Jun 24 04:22:32 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550bd78f-36fa-4eb2-8d7d-f895aab46d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53700a8-1264-4239-80a2-d21887f33f43', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538ab0bf-15e4-4fdf-b3f5-33a4393109b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:32 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Volume volume-e53700a8-1264-4239-80a2-d21887f33f43 (e53700a8-1264-4239-80a2-d21887f33f43): created successfully
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538ab0bf-15e4-4fdf-b3f5-33a4393109b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Flow 'volume_create_manager' (5fba01f8-e34e-48f7-be2c-b2a5504f50bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:32 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-34de4e1f-28cc-4f68-a0b0-abb5cd1fa4b6 tempest-AttachVolumeNegativeTest-596704228 None] Created volume successfully.
Jun 24 04:22:32 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-867e4adf-cfda-4050-b6d8-ec163dae6ade req-0707da86-ad9d-41bf-86df-bc3545e3f4a0 tempest-TestInstancesWithCinderVolumes-130270379 None] Terminate volume connection completed successfully.
Jun 24 04:22:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-867e4adf-cfda-4050-b6d8-ec163dae6ade req-0707da86-ad9d-41bf-86df-bc3545e3f4a0 tempest-TestInstancesWithCinderVolumes-130270379 None] Deleting attachment ab9cd521-d8d0-42d5-8989-1db22169ad4d. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:22:33 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4" returned: 0 in 0.807s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:33 devstack sudo[105200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28
Jun 24 04:22:33 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:33 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94 1073741824" returned: 0 in 0.891s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:33 devstack sudo[105202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94
Jun 24 04:22:33 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:34 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28" returned: 0 in 0.834s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:34 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28
Jun 24 04:22:34 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:34 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94" returned: 0 in 0.697s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f03d3fc-1807-42ed-9206-47c0dab3805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb826104-00c0-408d-bdb3-823788a93622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:34 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Volume volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94 (a86e3045-26b8-4947-b1e7-91cc4bd74e94): created successfully
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb826104-00c0-408d-bdb3-823788a93622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Flow 'volume_create_manager' (f2051c28-f1ed-4333-a34f-8f702090fc0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:34 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c8a8a772-dfbb-435e-a86f-2317da72ce78 tempest-VolumesTransfersTest-109370086 None] Created volume successfully.
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "cinder-297150f5-067c-457b-adb9-120befe1c128-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-297150f5-067c-457b-adb9-120befe1c128-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "cinder-quobyte-297150f5-067c-457b-adb9-120befe1c128" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:34 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-quobyte-297150f5-067c-457b-adb9-120befe1c128" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4.d7fd18a1-5f78-449f-8d0d-86721fcc2b28" returned: 0 in 0.693s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f312045-16c7-4e07-a5ad-249c57d7339c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-d7fd18a1-5f78-449f-8d0d-86721fcc2b28" released by "_delete_snapshot" :: held 3.229s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-57130efa-d192-4117-97a9-041491f81be4" released by "delete_snapshot" :: held 3.251s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:34 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Created reservations ['d1c519ea-f53a-4ba2-b513-7d517918e223', '595d1a22-a2ec-4d81-ae23-9ec9fa57eb1b', '9f5213bc-14c4-4fb4-8776-3690092ae692', '9ba23e1b-baaf-49df-895e-d54c57040e7e'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:34 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128
Jun 24 04:22:34 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:34 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Delete snapshot completed successfully.
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-d7fd18a1-5f78-449f-8d0d-86721fcc2b28-delete_snapshot" released by "delete_snapshot" :: held 3.410s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Snapshots deleted, issuing volume delete {{(pid=93470) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-57130efa-d192-4117-97a9-041491f81be4" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-57130efa-d192-4117-97a9-041491f81be4" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b1de66-5a65-4bd1-8c5a-f75640a12e21]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:35 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4
Jun 24 04:22:35 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Acquiring lock "cinder-a86e3045-26b8-4947-b1e7-91cc4bd74e94-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Lock "cinder-a86e3045-26b8-4947-b1e7-91cc4bd74e94-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Acquiring lock "cinder-quobyte-a86e3045-26b8-4947-b1e7-91cc4bd74e94" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Lock "cinder-quobyte-a86e3045-26b8-4947-b1e7-91cc4bd74e94" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48ebe3e-6ab2-435f-b4e7-3a4e88d8ac19]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:35 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94
Jun 24 04:22:35 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:35 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128" returned: 0 in 0.960s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:35 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128
Jun 24 04:22:35 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:36 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4" returned: 0 in 1.054s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:36 devstack sudo[105234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4
Jun 24 04:22:36 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:36 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94" returned: 0 in 0.970s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:36 devstack sudo[105241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94
Jun 24 04:22:36 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:36 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-297150f5-067c-457b-adb9-120befe1c128" returned: 0 in 0.911s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-quobyte-297150f5-067c-457b-adb9-120befe1c128" released by "delete_volume" :: held 1.929s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:36 devstack cinder-volume[93470]: WARNING cinder.quota [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296756984-1722343527 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296756984-1722343527, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:22:36 devstack cinder-volume[93470]: WARNING cinder.quota [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296756984-1722343527 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296756984-1722343527, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Created reservations ['1dec8674-8279-4cbe-8f42-bbe782040a25', 'fa07f8bb-b718-4dea-bbe2-37f3cd53e529', 'f2983745-52af-4d3d-ba7d-1276ddf716c1', '19f4bae7-92ef-4e39-b1f4-8291bc4be0b5'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:36 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57130efa-d192-4117-97a9-041491f81be4" returned: 0 in 0.789s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:36 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:36 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-57130efa-d192-4117-97a9-041491f81be4" released by "delete_volume" :: held 1.938s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-5688fd3e-752f-4cab-9c25-3e571128522f req-2344a814-cfeb-43ec-8b23-bc0842464290 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-5688fd3e-752f-4cab-9c25-3e571128522f req-2344a814-cfeb-43ec-8b23-bc0842464290 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Created reservations ['e85823dc-0f1e-48cb-85c1-aa6368338050', '34eca540-eb46-4067-80b9-97e372e6d3a3', '3fa1cf5b-3a67-4dc4-ae49-45844c9c1941', '2825fb88-68fb-489c-a2e8-2cc781d0bea1'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c623926-2a46-4e22-8e57-9437d2ce5669]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-5688fd3e-752f-4cab-9c25-3e571128522f req-2344a814-cfeb-43ec-8b23-bc0842464290 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:37 devstack sudo[105259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:37 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:37 devstack sudo[105254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43
Jun 24 04:22:37 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:37 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a86e3045-26b8-4947-b1e7-91cc4bd74e94" returned: 0 in 1.096s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:37 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.836s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Lock "cinder-quobyte-a86e3045-26b8-4947-b1e7-91cc4bd74e94" released by "delete_volume" :: held 2.140s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:37 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Deleted volume successfully.
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32a3cf07-57a8-499e-b8d7-5524b62027af tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-297150f5-067c-457b-adb9-120befe1c128-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Created reservations ['803d082d-7655-44ff-8c02-d4c9fbc5f292', '279ca151-6cf1-4ce8-a629-cc686c5097d6', '408a7b73-8ac1-429a-a359-20e4f5dfacff', 'e09fccc3-e533-4977-8e5d-2c10ba206205'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:37 devstack sudo[105279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:37 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:38 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.858s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Deleted volume successfully.
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fad4f47d-c5ef-48b0-b6c5-7503bd9f549e tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-57130efa-d192-4117-97a9-041491f81be4-delete_volume" released by "delete_volume" :: held 6.557s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:38 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-5688fd3e-752f-4cab-9c25-3e571128522f req-2344a814-cfeb-43ec-8b23-bc0842464290 tempest-AttachVolumeNegativeTest-596704228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43" returned: 0 in 1.094s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-5688fd3e-752f-4cab-9c25-3e571128522f req-2344a814-cfeb-43ec-8b23-bc0842464290 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.138s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-5688fd3e-752f-4cab-9c25-3e571128522f req-2344a814-cfeb-43ec-8b23-bc0842464290 tempest-AttachVolumeNegativeTest-596704228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-e53700a8-1264-4239-80a2-d21887f33f43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea244911-9705-4909-b869-44c4ae3f2a60', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:22:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-5688fd3e-752f-4cab-9c25-3e571128522f req-2344a814-cfeb-43ec-8b23-bc0842464290 tempest-AttachVolumeNegativeTest-596704228 None] attachment_update completed successfully.
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-dd3f97e4-0ce6-470f-8849-b5f64f314464-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-dd3f97e4-0ce6-470f-8849-b5f64f314464-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "cinder-quobyte-dd3f97e4-0ce6-470f-8849-b5f64f314464" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-dd3f97e4-0ce6-470f-8849-b5f64f314464" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[da28b4a1-5285-42a3-a65b-8f36cb4f9112]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:38 devstack sudo[105286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464
Jun 24 04:22:38 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:38 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.810s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Deleted volume successfully.
Jun 24 04:22:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a70e8095-749b-4289-b462-3ce9e1a93ac8 tempest-VolumesTransfersTest-1067897528 None] Lock "cinder-a86e3045-26b8-4947-b1e7-91cc4bd74e94-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:39 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464" returned: 0 in 0.874s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:39 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464
Jun 24 04:22:39 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:40 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-dd3f97e4-0ce6-470f-8849-b5f64f314464" returned: 0 in 0.724s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-quobyte-dd3f97e4-0ce6-470f-8849-b5f64f314464" released by "delete_volume" :: held 1.648s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Created reservations ['6cf73137-9464-4c5b-a26b-00204151ffe1', 'a8b0bec3-8a10-44d7-a6d7-99d63e36662d', 'a0d57cdc-7ae9-435f-a0e6-81238667298e', 'ef66e7d9-63df-4159-9d54-3e260c9506dc'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:40 devstack sudo[105305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:40 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-de37e9f6-8b56-4bd9-8ded-18afc576008a req-ebbdca19-07dd-4b36-aa47-5323a2127a37 tempest-TestInstancesWithCinderVolumes-130270379 None] Terminate volume connection completed successfully.
Jun 24 04:22:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-de37e9f6-8b56-4bd9-8ded-18afc576008a req-ebbdca19-07dd-4b36-aa47-5323a2127a37 tempest-TestInstancesWithCinderVolumes-130270379 None] Deleting attachment ba5a73ba-cc4c-4e9f-9ae5-5c79582042da. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:22:41 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.859s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:41 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:41 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Deleted volume successfully.
Jun 24 04:22:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e7996669-3b09-4e2f-9751-cd1531a0977d tempest-VolumesDeleteCascade-470049609 None] Lock "cinder-dd3f97e4-0ce6-470f-8849-b5f64f314464-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "cinder-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:42 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=105,cinder:SELECT=103,cinder:INSERT=34,cinder:DELETE=7 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:22:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "cinder-quobyte-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-quobyte-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd" acquired by "delete_volume" :: waited 0.038s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:42 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5b93d1-12e5-47cf-b697-a35d88aab515]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:42 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd
Jun 24 04:22:42 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd" returned: 0 in 1.371s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:43 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:43 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd
Jun 24 04:22:43 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:44 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd" returned: 0 in 0.837s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-quobyte-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd" released by "delete_volume" :: held 2.274s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=104,cinder:UPDATE=102,cinder:DELETE=10,cinder:INSERT=27 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:22:44 devstack cinder-volume[93470]: WARNING cinder.quota [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-153442024-815617654 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-153442024-815617654, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:22:44 devstack cinder-volume[93470]: WARNING cinder.quota [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-153442024-815617654 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-153442024-815617654, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Created reservations ['4002d636-2247-47f1-9e88-1ba73a80376d', '571a764f-59c2-4747-856b-26238445c376', '7f576e92-1986-4dc7-80df-dbf6fb76b702', '32f34bd9-7686-4df9-8def-a29b06612704'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:44 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:44 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:45 devstack sudo[105326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:45 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Flow 'volume_create_manager' (8c94cb6a-7b21-48e7-8a66-d4d768cf3844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074ca95c-28c3-4dc9-8945-eb6ca20b9898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-13f1333c-864e-4188-a303-8d6bf53dfd86 req-9f2bd549-8422-4a4e-9297-155411544dc7 tempest-AttachVolumeNegativeTest-596704228 None] Terminate volume connection completed successfully.
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-13f1333c-864e-4188-a303-8d6bf53dfd86 req-9f2bd549-8422-4a4e-9297-155411544dc7 tempest-AttachVolumeNegativeTest-596704228 None] Deleting attachment ea244911-9705-4909-b869-44c4ae3f2a60. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074ca95c-28c3-4dc9-8945-eb6ca20b9898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827377759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d31ea64-9858-4052-b54e-906145ff0c68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6764f1d3907406f89bcd0aed7c00079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:45Z,use_quota=True,user_id='48923795baa94846ad379a6e27240b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b66b14-bfb7-4033-965f-436659f66c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b66b14-bfb7-4033-965f-436659f66c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f6ceb1-d188-4c05-9b04-c21dc62c0574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f6ceb1-d188-4c05-9b04-c21dc62c0574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d31ea64-9858-4052-b54e-906145ff0c68', 'volume_name': 'volume-1d31ea64-9858-4052-b54e-906145ff0c68', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764bb166-dc0b-451b-b780-495053b7d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764bb166-dc0b-451b-b780-495053b7d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5c53cd-838f-4137-ae8a-6c71dd47669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:45 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Volume 1d31ea64-9858-4052-b54e-906145ff0c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d31ea64-9858-4052-b54e-906145ff0c68', 'volume_size': 1}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827377759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d31ea64-9858-4052-b54e-906145ff0c68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6764f1d3907406f89bcd0aed7c00079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:45Z,use_quota=True,user_id='48923795baa94846ad379a6e27240b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Creating volume 1d31ea64-9858-4052-b54e-906145ff0c68 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:45 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:45 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.075s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:45 devstack sudo[105333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68 1073741824
Jun 24 04:22:45 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Deleted volume successfully.
Jun 24 04:22:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7c2e103a-2e28-41d2-822c-fff4516ffb84 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-8b992270-4cd3-4f11-a0b1-e4e7d5cba3cd-delete_volume" released by "delete_volume" :: held 3.717s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:46 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.075s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:22:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:22:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:22:46 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68 1073741824" returned: 0 in 1.033s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:46 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68
Jun 24 04:22:46 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:47 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68" returned: 0 in 1.166s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5c53cd-838f-4137-ae8a-6c71dd47669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d31ea64-9858-4052-b54e-906145ff0c68', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9641871e-ef60-4264-8062-438389be73ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:48 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Volume volume-1d31ea64-9858-4052-b54e-906145ff0c68 (1d31ea64-9858-4052-b54e-906145ff0c68): created successfully
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9641871e-ef60-4264-8062-438389be73ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Flow 'volume_create_manager' (8c94cb6a-7b21-48e7-8a66-d4d768cf3844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:48 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3b40526a-dc0c-4c2b-aa46-e454653838d8 tempest-VolumesListTestJSON-714436098 None] Created volume successfully.
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Flow 'volume_create_manager' (7fc6a1a0-ac48-47ff-b354-0f9f05c5ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf648c1-cdd5-456c-ad19-440042be253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf648c1-cdd5-456c-ad19-440042be253d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1994539849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2d3755-c9a0-4ca7-99ed-39e73daeea44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b17884b21147388dd8020817be8bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:48Z,use_quota=True,user_id='decbc26712554b7997b4b469308c56e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05176131-4a68-4f10-b83c-b732f650358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05176131-4a68-4f10-b83c-b732f650358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5927d44-28da-49a7-bc95-004af2e548c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5927d44-28da-49a7-bc95-004af2e548c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2d3755-c9a0-4ca7-99ed-39e73daeea44', 'volume_name': 'volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e99183-5e39-4eb6-81e7-bb32330646c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e99183-5e39-4eb6-81e7-bb32330646c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcae80d-cf5f-4873-ac20-675f05cdfd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:48 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Volume fc2d3755-c9a0-4ca7-99ed-39e73daeea44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44', 'volume_size': 1}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1994539849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2d3755-c9a0-4ca7-99ed-39e73daeea44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b17884b21147388dd8020817be8bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:48Z,use_quota=True,user_id='decbc26712554b7997b4b469308c56e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Creating volume fc2d3755-c9a0-4ca7-99ed-39e73daeea44 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:48 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:48 devstack sudo[105386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44 1073741824
Jun 24 04:22:48 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Flow 'volume_create_manager' (425dd818-6bd9-478f-bf68-19294fc2ddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953d5678-10a0-497c-b3ae-482f7bd24447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953d5678-10a0-497c-b3ae-482f7bd24447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1596429824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6764f1d3907406f89bcd0aed7c00079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:49Z,use_quota=True,user_id='48923795baa94846ad379a6e27240b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d1ff11-e90d-466e-bc99-de6c0070c66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d1ff11-e90d-466e-bc99-de6c0070c66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098763fd-b758-433c-883a-db4907c640f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098763fd-b758-433c-883a-db4907c640f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf', 'volume_name': 'volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f7834b-208e-4982-b2a7-0266cf50d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f7834b-208e-4982-b2a7-0266cf50d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b19989-1889-4dac-8fac-122b24de90b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Volume 4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf', 'volume_size': 1}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:49 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44 1073741824" returned: 0 in 1.380s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:50 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44
Jun 24 04:22:50 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:50 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44" returned: 0 in 0.652s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.209s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1596429824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6764f1d3907406f89bcd0aed7c00079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:49Z,use_quota=True,user_id='48923795baa94846ad379a6e27240b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Creating volume 4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:50 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:50 devstack sudo[105437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf 1073741824
Jun 24 04:22:50 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcae80d-cf5f-4873-ac20-675f05cdfd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90276b7d-4ff9-4b07-8089-65b1dbcc4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:50 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Volume volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44 (fc2d3755-c9a0-4ca7-99ed-39e73daeea44): created successfully
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90276b7d-4ff9-4b07-8089-65b1dbcc4452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Flow 'volume_create_manager' (7fc6a1a0-ac48-47ff-b354-0f9f05c5ed60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:50 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-121c1957-a791-48d8-830c-5c7fb49aabb5 tempest-VolumesTransfersV355Test-441821874 None] Created volume successfully.
Jun 24 04:22:50 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-ea50b5aa-5366-4e5a-b5d8-f41f1e6f9a4e req-be46b1e4-a845-431f-b9b9-1b42a3a1b9c2 tempest-TestInstancesWithCinderVolumes-130270379 None] Terminate volume connection completed successfully.
Jun 24 04:22:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-ea50b5aa-5366-4e5a-b5d8-f41f1e6f9a4e req-be46b1e4-a845-431f-b9b9-1b42a3a1b9c2 tempest-TestInstancesWithCinderVolumes-130270379 None] Deleting attachment 9e3384d4-7a8d-4fbd-b866-d3c935eab508. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:22:51 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf 1073741824" returned: 0 in 0.939s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:51 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf
Jun 24 04:22:51 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6bce99af-8578-4c11-8c70-4ad0fa4223c9 tempest-VolumesTransfersV355Test-25057019 None] Transfer volume completed successfully.
Jun 24 04:22:52 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf" returned: 0 in 0.753s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b19989-1889-4dac-8fac-122b24de90b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634a7bbd-ecc0-4523-b691-ee624b0a1824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:52 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Volume volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf (4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf): created successfully
Jun 24 04:22:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634a7bbd-ecc0-4523-b691-ee624b0a1824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Flow 'volume_create_manager' (425dd818-6bd9-478f-bf68-19294fc2ddb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-387707b9-d1ff-4178-b0c5-130e8d639411 tempest-VolumesListTestJSON-714436098 None] Created volume successfully.
Jun 24 04:22:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Acquiring lock "cinder-fc2d3755-c9a0-4ca7-99ed-39e73daeea44-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Lock "cinder-fc2d3755-c9a0-4ca7-99ed-39e73daeea44-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Acquiring lock "cinder-quobyte-fc2d3755-c9a0-4ca7-99ed-39e73daeea44" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Lock "cinder-quobyte-fc2d3755-c9a0-4ca7-99ed-39e73daeea44" acquired by "delete_volume" :: waited 0.013s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb83f2-e6bc-4e16-8688-ea69c2e1029b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:53 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44
Jun 24 04:22:53 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Flow 'volume_create_manager' (2692372d-517a-41aa-a7f9-5b75de279ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be6d8f5-895a-4c1b-bcc8-b2d0426147c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be6d8f5-895a-4c1b-bcc8-b2d0426147c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1846010709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aab6af5-1811-43fd-a7aa-829155e8fb3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6764f1d3907406f89bcd0aed7c00079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:54Z,use_quota=True,user_id='48923795baa94846ad379a6e27240b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0f4354-aa64-403d-9015-d363665b6649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0f4354-aa64-403d-9015-d363665b6649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7b2cb3-f697-4e23-888e-033d7e1aea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7b2cb3-f697-4e23-888e-033d7e1aea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aab6af5-1811-43fd-a7aa-829155e8fb3b', 'volume_name': 'volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a445047-61a2-4ae7-bf8a-c9f6390ebe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:54 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a445047-61a2-4ae7-bf8a-c9f6390ebe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0dc65c-b57b-4507-a835-1ca42d70f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:54 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Volume 6aab6af5-1811-43fd-a7aa-829155e8fb3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b', 'volume_size': 1}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1846010709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aab6af5-1811-43fd-a7aa-829155e8fb3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6764f1d3907406f89bcd0aed7c00079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:54Z,use_quota=True,user_id='48923795baa94846ad379a6e27240b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Creating volume 6aab6af5-1811-43fd-a7aa-829155e8fb3b {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:54 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44" returned: 0 in 0.825s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:54 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b 1073741824
Jun 24 04:22:54 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:54 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44
Jun 24 04:22:54 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "cinder-d96396f7-3111-4d26-a078-ff58e027f84b-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-d96396f7-3111-4d26-a078-ff58e027f84b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "cinder-quobyte-d96396f7-3111-4d26-a078-ff58e027f84b" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-quobyte-d96396f7-3111-4d26-a078-ff58e027f84b" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1231f2b9-f66a-41b2-aa8e-4d57ae642430]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:54 devstack sudo[105460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:22:54 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:54 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fc2d3755-c9a0-4ca7-99ed-39e73daeea44" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Lock "cinder-quobyte-fc2d3755-c9a0-4ca7-99ed-39e73daeea44" released by "delete_volume" :: held 1.602s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:54 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Created reservations ['7a222486-7f32-4d77-94d8-98e79421c3a0', '15408dbc-08ff-408e-b9a4-b35fb85a3f2e', 'b47114ff-d739-436c-bd05-6d9def006f59', '04b6066a-f56a-41df-b809-93293c48e13f'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:55 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:55 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:55 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b 1073741824" returned: 0 in 1.020s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:55 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b
Jun 24 04:22:55 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:55 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 0 in 0.977s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:55 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:22:55 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:55 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.872s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:55 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Deleted volume successfully.
Jun 24 04:22:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8f235365-393e-4e82-9a01-f5e14ededb86 tempest-VolumesTransfersV355Test-1113356543 None] Lock "cinder-fc2d3755-c9a0-4ca7-99ed-39e73daeea44-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:56 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b" returned: 0 in 0.817s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0dc65c-b57b-4507-a835-1ca42d70f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38de0a3-785d-4ec9-8226-1e0e3d6a6e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:56 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Volume volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b (6aab6af5-1811-43fd-a7aa-829155e8fb3b): created successfully
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38de0a3-785d-4ec9-8226-1e0e3d6a6e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Flow 'volume_create_manager' (2692372d-517a-41aa-a7f9-5b75de279ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0f49ec84-2397-4948-a5e9-ac5e3fc17f73 tempest-VolumesListTestJSON-714436098 None] Created volume successfully.
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Flow 'volume_create_manager' (51d3c0bb-4494-4280-a7b6-7fb54b77cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9522950b-17a2-471f-bdb4-89196796bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9522950b-17a2-471f-bdb4-89196796bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1797700261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d49040-0a12-4dc9-8587-adba106550f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b17884b21147388dd8020817be8bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:56Z,use_quota=True,user_id='decbc26712554b7997b4b469308c56e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85d1e2d-3687-4536-957c-a276b99363e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85d1e2d-3687-4536-957c-a276b99363e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a3ae46-2340-48a8-bbf0-3dcba1da7833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a3ae46-2340-48a8-bbf0-3dcba1da7833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d49040-0a12-4dc9-8587-adba106550f2', 'volume_name': 'volume-49d49040-0a12-4dc9-8587-adba106550f2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9426601-8729-47d8-a408-bfa97fd03b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9426601-8729-47d8-a408-bfa97fd03b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af86e899-b48a-4bd0-9ea9-3b87a254cc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:56 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Volume 49d49040-0a12-4dc9-8587-adba106550f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d49040-0a12-4dc9-8587-adba106550f2', 'volume_size': 1}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1797700261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d49040-0a12-4dc9-8587-adba106550f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b17884b21147388dd8020817be8bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:56Z,use_quota=True,user_id='decbc26712554b7997b4b469308c56e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Creating volume 49d49040-0a12-4dc9-8587-adba106550f2 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:56 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:56 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2 1073741824
Jun 24 04:22:56 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:56 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 1 in 1.010s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:22:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:56 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b
Jun 24 04:22:56 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:57 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d96396f7-3111-4d26-a078-ff58e027f84b" returned: 0 in 0.717s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-quobyte-d96396f7-3111-4d26-a078-ff58e027f84b" released by "delete_volume" :: held 2.788s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "cinder-e53700a8-1264-4239-80a2-d21887f33f43-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-e53700a8-1264-4239-80a2-d21887f33f43-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:57 devstack cinder-volume[93470]: WARNING cinder.quota [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2059630181-868726429 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2059630181-868726429, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:22:57 devstack cinder-volume[93470]: WARNING cinder.quota [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2059630181-868726429 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2059630181-868726429, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:22:57 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "cinder-quobyte-e53700a8-1264-4239-80a2-d21887f33f43" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2 1073741824" returned: 0 in 1.048s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Created reservations ['9ed461e5-7ce3-4b3a-90d4-718a2f7b0693', 'eb960238-cf5e-4dff-a2e6-806e8f31c1c5', '3cfc3234-b729-46e4-afab-fcb0ee36df92', '0dc7c8e9-5f58-4605-b3e9-4e25e729fd3c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-quobyte-e53700a8-1264-4239-80a2-d21887f33f43" acquired by "delete_volume" :: waited 0.031s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2bf907-f4bf-49bf-9950-ecbc59e237ba]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:57 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2
Jun 24 04:22:57 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:57 devstack sudo[105499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:57 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:57 devstack sudo[105496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43
Jun 24 04:22:57 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:58 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.906s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:58 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Deleted volume successfully.
Jun 24 04:22:58 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2" returned: 0 in 1.019s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb973e55-9743-4f46-be9d-2fc78598c7e6 tempest-TestInstancesWithCinderVolumes-130270379 None] Lock "cinder-d96396f7-3111-4d26-a078-ff58e027f84b-delete_volume" released by "delete_volume" :: held 4.099s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af86e899-b48a-4bd0-9ea9-3b87a254cc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d49040-0a12-4dc9-8587-adba106550f2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc566164-26fe-4c74-8eca-07ce5ac208aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:58 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Volume volume-49d49040-0a12-4dc9-8587-adba106550f2 (49d49040-0a12-4dc9-8587-adba106550f2): created successfully
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc566164-26fe-4c74-8eca-07ce5ac208aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Flow 'volume_create_manager' (51d3c0bb-4494-4280-a7b6-7fb54b77cab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:58 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:58 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a43498e4-b952-4969-9ad4-d0524a03673d tempest-VolumesTransfersV355Test-441821874 None] Created volume successfully.
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43" returned: 0 in 1.145s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:58 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43
Jun 24 04:22:58 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:59 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e53700a8-1264-4239-80a2-d21887f33f43" returned: 0 in 0.699s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-quobyte-e53700a8-1264-4239-80a2-d21887f33f43" released by "delete_volume" :: held 1.897s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Created reservations ['e322f704-e389-4721-b19a-1eadbce830c2', '9da90ec9-7673-4f9c-8284-b964020862fd', '1f552363-a3a5-4bed-9411-b281469fa376', 'ff23b111-4e65-45f0-9ce2-e5d2a555d352'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:59 devstack sudo[105510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:22:59 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Acquiring lock "cinder-49d49040-0a12-4dc9-8587-adba106550f2-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Lock "cinder-49d49040-0a12-4dc9-8587-adba106550f2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "cinder-938da82a-5ebd-4ecb-878a-caf250d28b43-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Acquiring lock "cinder-quobyte-49d49040-0a12-4dc9-8587-adba106550f2" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-938da82a-5ebd-4ecb-878a-caf250d28b43-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Lock "cinder-quobyte-49d49040-0a12-4dc9-8587-adba106550f2" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "cinder-quobyte-938da82a-5ebd-4ecb-878a-caf250d28b43" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe619f4e-c1ae-4aac-98a3-16bb146759c8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-quobyte-938da82a-5ebd-4ecb-878a-caf250d28b43" acquired by "delete_volume" :: waited 0.043s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:00 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44985c6-72de-4a26-acd7-ff13e591cec4]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:00 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2
Jun 24 04:23:00 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:00 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43
Jun 24 04:23:00 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:00 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.193s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:00 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Deleted volume successfully.
Jun 24 04:23:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f4448c5d-c3c4-4d93-bbf2-a049bb14c3c7 tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-e53700a8-1264-4239-80a2-d21887f33f43-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:00 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43" returned: 0 in 0.976s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:01 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "cinder-6aab6af5-1811-43fd-a7aa-829155e8fb3b-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:01 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:01 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2" returned: 0 in 1.122s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Lock "cinder-6aab6af5-1811-43fd-a7aa-829155e8fb3b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:01 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2
Jun 24 04:23:01 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "cinder-quobyte-6aab6af5-1811-43fd-a7aa-829155e8fb3b" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Lock "cinder-quobyte-6aab6af5-1811-43fd-a7aa-829155e8fb3b" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f5140a-267b-41aa-9938-8c0c07a91c82]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:01 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b
Jun 24 04:23:01 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:01 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-938da82a-5ebd-4ecb-878a-caf250d28b43" returned: 0 in 0.798s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-quobyte-938da82a-5ebd-4ecb-878a-caf250d28b43" released by "delete_volume" :: held 1.830s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Created reservations ['182506b7-22b5-4706-bc80-9354030706ae', '2d5132e8-04f8-4514-8edf-35d56fad10d1', 'dfce8dce-32f5-46e1-9c2e-4d6fa98c56ee', '73896872-7c8a-4ee5-a414-a56800c9183d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:01 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49d49040-0a12-4dc9-8587-adba106550f2" returned: 0 in 0.816s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Lock "cinder-quobyte-49d49040-0a12-4dc9-8587-adba106550f2" released by "delete_volume" :: held 2.008s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:02 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:02 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Created reservations ['567bc089-6000-45cc-bfae-9f6d695dbd06', '6f28a5fb-c942-4bdf-a958-7388d97cef69', '6a8493b2-3e10-4217-80c1-e1eb6092dd46', 'f6c2b20a-2053-4521-830c-bfb87516fa45'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:02 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:02 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:02 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b" returned: 0 in 1.157s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:02 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b
Jun 24 04:23:02 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "cinder-8bdb39b7-4934-4660-b043-80d2b255a496-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-8bdb39b7-4934-4660-b043-80d2b255a496-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "cinder-quobyte-8bdb39b7-4934-4660-b043-80d2b255a496" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-quobyte-8bdb39b7-4934-4660-b043-80d2b255a496" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fd0645-500a-4f70-b409-a94d9a933a18]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:02 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496
Jun 24 04:23:02 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:03 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.240s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:03 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Deleted volume successfully.
Jun 24 04:23:03 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.967s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:03 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Deleted volume successfully.
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ad16a347-b385-4d59-b27d-8c02da1fcc92 tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-938da82a-5ebd-4ecb-878a-caf250d28b43-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aa4557-daa5-4f4a-b544-76a2f19f6346 tempest-VolumesTransfersV355Test-1113356543 None] Lock "cinder-49d49040-0a12-4dc9-8587-adba106550f2-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:03 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6aab6af5-1811-43fd-a7aa-829155e8fb3b" returned: 0 in 1.132s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Lock "cinder-quobyte-6aab6af5-1811-43fd-a7aa-829155e8fb3b" released by "delete_volume" :: held 2.352s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Created reservations ['32f2e820-88c3-4585-844c-59019e199a1e', '8e039aef-c1dc-4ddc-a651-2ec7f5d717d3', 'd5fc17c2-e4a7-46d0-a340-f3bb6f13882e', 'ecbb32a5-6814-4469-b2c1-cc90c529ee13'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:03 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:03 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:03 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496" returned: 0 in 1.158s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:03 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496
Jun 24 04:23:03 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:04 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.948s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Deleted volume successfully.
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7afe8333-d71c-4283-ba55-70477b797889 tempest-VolumesListTestJSON-714436098 None] Lock "cinder-6aab6af5-1811-43fd-a7aa-829155e8fb3b-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "cinder-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Lock "cinder-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "cinder-quobyte-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Lock "cinder-quobyte-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa6c2c-8ebb-49ae-b727-564f1f07c4f8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:04 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8bdb39b7-4934-4660-b043-80d2b255a496" returned: 0 in 1.051s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-quobyte-8bdb39b7-4934-4660-b043-80d2b255a496" released by "delete_volume" :: held 2.267s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Created reservations ['fbcf099c-ffc7-458d-ae86-35058a04e199', '5696ae99-f83d-4ec1-84bd-9d9a7af4f306', '09e13cd8-5238-4372-a2f2-929e711ebea6', '73f50f09-4a2f-4b7d-ba01-e3ecf6c6a91d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:05 devstack sudo[105558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf
Jun 24 04:23:05 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:05 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:05 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf" returned: 0 in 1.037s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:05 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:05 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf
Jun 24 04:23:05 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:06 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.953s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Deleted volume successfully.
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ba8986dc-9aa1-4026-ac5a-9028cc68319e tempest-AttachVolumeNegativeTest-596704228 None] Lock "cinder-8bdb39b7-4934-4660-b043-80d2b255a496-delete_volume" released by "delete_volume" :: held 3.499s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:06 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf" returned: 0 in 0.781s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Lock "cinder-quobyte-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf" released by "delete_volume" :: held 1.870s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Created reservations ['4c5a687c-a544-4005-9bed-92b35689b10d', 'a6326466-0135-4f94-92c8-f9c5dc66147f', '05adf745-f762-4d50-bc51-67aa4291b594', '093dd081-f76c-4328-bcde-91ddbf952765'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:06 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:06 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Acquiring lock "cinder-1d31ea64-9858-4052-b54e-906145ff0c68-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Lock "cinder-1d31ea64-9858-4052-b54e-906145ff0c68-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Acquiring lock "cinder-quobyte-1d31ea64-9858-4052-b54e-906145ff0c68" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Lock "cinder-quobyte-1d31ea64-9858-4052-b54e-906145ff0c68" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fb54a1-96db-45d8-a310-638f918b9097]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:07 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68
Jun 24 04:23:07 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:07 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.919s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:07 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Deleted volume successfully.
Jun 24 04:23:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b995e319-1ca7-4a0a-9a38-1504424b88b2 tempest-VolumesListTestJSON-714436098 None] Lock "cinder-4cc9fd12-6442-4ef6-9918-e2c6a77fe1cf-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68" returned: 0 in 0.877s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:08 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:08 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68
Jun 24 04:23:08 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:09 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1d31ea64-9858-4052-b54e-906145ff0c68" returned: 0 in 0.856s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Lock "cinder-quobyte-1d31ea64-9858-4052-b54e-906145ff0c68" released by "delete_volume" :: held 1.819s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Created reservations ['25cc217d-4ac2-4790-8b98-78d3908c6ec8', 'c0e40473-0f69-4a91-b01f-f971c3930b9e', '7c3c4803-012c-44bd-a02a-eb02d203e181', '22779f86-0d32-410a-be1d-87b56463a0f2'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:09 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:09 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:10 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.967s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:10 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Deleted volume successfully.
Jun 24 04:23:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdd69e40-8453-448f-9cb7-d15fb0b6e6be tempest-VolumesListTestJSON-714436098 None] Lock "cinder-1d31ea64-9858-4052-b54e-906145ff0c68-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (87eeaa0c-6292-409c-8205-3a64c16bda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1bd59f-1b0a-4db9-b2aa-417ec1db01a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1bd59f-1b0a-4db9-b2aa-417ec1db01a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826993442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e226317-c361-4797-a898-d5c6cb601033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:15Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a528a96a-7052-4623-8471-cfc02ee39545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a528a96a-7052-4623-8471-cfc02ee39545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8152107f-52d2-4211-92f6-55f2033d94e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8152107f-52d2-4211-92f6-55f2033d94e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e226317-c361-4797-a898-d5c6cb601033', 'volume_name': 'volume-1e226317-c361-4797-a898-d5c6cb601033', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bd0a34-d942-4981-a32c-a712534f3a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bd0a34-d942-4981-a32c-a712534f3a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8741f4-0493-4643-8509-6d56dc1cd4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:14 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Volume 1e226317-c361-4797-a898-d5c6cb601033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e226317-c361-4797-a898-d5c6cb601033', 'volume_size': 1}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826993442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e226317-c361-4797-a898-d5c6cb601033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:15Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Creating volume 1e226317-c361-4797-a898-d5c6cb601033 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:14 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:15 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033 1073741824
Jun 24 04:23:15 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (63ef4f9c-ae78-4393-864b-362435d9524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4be7ba-c4ac-47e5-a6ef-8972e3790116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4be7ba-c4ac-47e5-a6ef-8972e3790116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1046887926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f9a258-4114-4c4e-9f7a-24de106f0476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:15Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35093d85-d0a6-4280-aadb-4a3dcfc0c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35093d85-d0a6-4280-aadb-4a3dcfc0c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb437e3-1ceb-41c0-a619-78c91858fd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb437e3-1ceb-41c0-a619-78c91858fd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f9a258-4114-4c4e-9f7a-24de106f0476', 'volume_name': 'volume-f3f9a258-4114-4c4e-9f7a-24de106f0476', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bc6aac-cf61-48ef-a66c-bd48bf4b5270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bc6aac-cf61-48ef-a66c-bd48bf4b5270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e6feeb-0fb9-4bbe-8fc4-4edac07dca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Volume f3f9a258-4114-4c4e-9f7a-24de106f0476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f9a258-4114-4c4e-9f7a-24de106f0476', 'volume_size': 1}
Jun 24 04:23:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (544fb43c-1ecf-46fe-89b2-817ae47e54f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592f1a55-0d10-4fb5-83f7-d2707cd9f5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592f1a55-0d10-4fb5-83f7-d2707cd9f5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1584673258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:16Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd46b41-f23f-486f-93e3-86450832b9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd46b41-f23f-486f-93e3-86450832b9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ff3c31-5b09-4feb-a3df-ec16833f34cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ff3c31-5b09-4feb-a3df-ec16833f34cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15', 'volume_name': 'volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472fbda0-688f-4f12-a364-6ab37e24d26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472fbda0-688f-4f12-a364-6ab37e24d26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ddbf95-dbf0-4f4c-a580-eee3c347ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:16 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Volume 23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15', 'volume_size': 1}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:16 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033 1073741824" returned: 0 in 1.740s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:16 devstack sudo[105634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033
Jun 24 04:23:16 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (65f57627-3707-4da5-9c50-72ce4bfc84f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9710d1-20d0-4131-8491-f750bc6b6d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9710d1-20d0-4131-8491-f750bc6b6d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892561496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce2f447-1ef2-4ea0-b6ce-060201bd1cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:17Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2bff8c-c7ba-40d6-8e3f-2dbef8190ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2bff8c-c7ba-40d6-8e3f-2dbef8190ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55bc1c3-4a82-4276-b650-340e8049cc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55bc1c3-4a82-4276-b650-340e8049cc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce2f447-1ef2-4ea0-b6ce-060201bd1cab', 'volume_name': 'volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923a6435-05f1-4508-8111-31d40f496096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923a6435-05f1-4508-8111-31d40f496096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7593e9a0-0f68-455b-9755-207a8f197e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Volume 5ce2f447-1ef2-4ea0-b6ce-060201bd1cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab', 'volume_size': 1}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:17 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033" returned: 0 in 0.809s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] <== create_volume: return (2624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.629s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.082s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1046887926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f9a258-4114-4c4e-9f7a-24de106f0476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:15Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Creating volume f3f9a258-4114-4c4e-9f7a-24de106f0476 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:17 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:17 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476 1073741824
Jun 24 04:23:17 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Flow 'volume_create_manager' (9bc7fc02-4d8f-485c-9a63-5b9b417f9248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c7c7cb-93c4-4975-91b2-0973a7bcacb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8741f4-0493-4643-8509-6d56dc1cd4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e226317-c361-4797-a898-d5c6cb601033', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e547796-c7de-44dd-b808-405ce6bbcb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c7c7cb-93c4-4975-91b2-0973a7bcacb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1135568509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fd9790-c51a-4001-8b1f-886a8fb58b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519ca4e6bb74ee499e9e00679932aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:17Z,use_quota=True,user_id='6df94a21388a415ba7b29b4686842a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be105812-78b9-46d5-8c0a-b7c97354fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be105812-78b9-46d5-8c0a-b7c97354fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bf7485-e403-4ccd-8607-f902f46e3bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bf7485-e403-4ccd-8607-f902f46e3bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16fd9790-c51a-4001-8b1f-886a8fb58b8a', 'volume_name': 'volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec7f0be-4bde-4719-8bc4-91b290bba4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec7f0be-4bde-4719-8bc4-91b290bba4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ead571a-56ec-401b-b0db-4c1ca20db83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Volume 16fd9790-c51a-4001-8b1f-886a8fb58b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a', 'volume_size': 1}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Volume volume-1e226317-c361-4797-a898-d5c6cb601033 (1e226317-c361-4797-a898-d5c6cb601033): created successfully
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e547796-c7de-44dd-b808-405ce6bbcb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (87eeaa0c-6292-409c-8205-3a64c16bda0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (f4e36d1f-e8ba-4500-8053-1a1158c00dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5be292-9cae-491f-854c-aa0a217e25e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5be292-9cae-491f-854c-aa0a217e25e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501427179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:18Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe5ca25-3eaa-4669-ad16-5f400e65ad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe5ca25-3eaa-4669-ad16-5f400e65ad6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28eaa10-752d-44c6-ad8c-949967b7c542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28eaa10-752d-44c6-ad8c-949967b7c542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7', 'volume_name': 'volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043ee8cd-5406-4ac1-a861-6572798a535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043ee8cd-5406-4ac1-a861-6572798a535a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a22b531-1c6a-4f63-935c-6908ce636892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Volume e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7', 'volume_size': 1}
Jun 24 04:23:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:17 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9a13988f-52f3-41ad-85af-44e0ec5883cf tempest-CreateVolumesFromImageTest-1777246095 None] Created volume successfully.
Jun 24 04:23:18 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476 1073741824" returned: 0 in 1.034s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:18 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476
Jun 24 04:23:18 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:19 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476" returned: 0 in 0.875s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.300s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1584673258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:16Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Creating volume 23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:19 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:19 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15 1073741824
Jun 24 04:23:19 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e6feeb-0fb9-4bbe-8fc4-4edac07dca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f9a258-4114-4c4e-9f7a-24de106f0476', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d3ac2-a123-40d3-8c56-8cb81aba16c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:19 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Volume volume-f3f9a258-4114-4c4e-9f7a-24de106f0476 (f3f9a258-4114-4c4e-9f7a-24de106f0476): created successfully
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d3ac2-a123-40d3-8c56-8cb81aba16c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (63ef4f9c-ae78-4393-864b-362435d9524b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:19 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1b6cd280-3190-4cdf-9ae7-29f8e077142c tempest-CreateVolumesFromImageTest-1777246095 None] Created volume successfully.
Jun 24 04:23:20 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15 1073741824" returned: 0 in 1.102s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:20 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15
Jun 24 04:23:20 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:21 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15" returned: 0 in 0.678s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.849s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892561496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce2f447-1ef2-4ea0-b6ce-060201bd1cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:17Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Creating volume 5ce2f447-1ef2-4ea0-b6ce-060201bd1cab {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:21 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ddbf95-dbf0-4f4c-a580-eee3c347ea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:21 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab 1073741824
Jun 24 04:23:21 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158ea565-3b99-4c3e-a054-00823789c933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:21 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Volume volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15 (23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15): created successfully
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158ea565-3b99-4c3e-a054-00823789c933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (544fb43c-1ecf-46fe-89b2-817ae47e54f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-837e08d1-8917-44df-98a1-edac47d51da8 tempest-CreateVolumesFromImageTest-1777246095 None] Created volume successfully.
Jun 24 04:23:22 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab 1073741824" returned: 0 in 1.177s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:22 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab
Jun 24 04:23:22 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:23 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab" returned: 0 in 0.706s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.591s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1135568509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fd9790-c51a-4001-8b1f-886a8fb58b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519ca4e6bb74ee499e9e00679932aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:17Z,use_quota=True,user_id='6df94a21388a415ba7b29b4686842a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Creating volume 16fd9790-c51a-4001-8b1f-886a8fb58b8a {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:23 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7593e9a0-0f68-455b-9755-207a8f197e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4ec6ca-57ab-46ff-b5c3-554e5b890c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:23 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a 1073741824
Jun 24 04:23:23 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:23 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Volume volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab (5ce2f447-1ef2-4ea0-b6ce-060201bd1cab): created successfully
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4ec6ca-57ab-46ff-b5c3-554e5b890c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (65f57627-3707-4da5-9c50-72ce4bfc84f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3ccca4c2-8501-4bda-8093-3505c42e66a4 tempest-CreateVolumesFromImageTest-1777246095 None] Created volume successfully.
Jun 24 04:23:24 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a 1073741824" returned: 0 in 1.045s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:24 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a
Jun 24 04:23:24 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:25 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a" returned: 0 in 0.907s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.418s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501427179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d98cb954ad3412faf6b330ae0c1c14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:18Z,use_quota=True,user_id='10175b3cedf748a1a1d0785db18ab4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Creating volume e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:25 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ead571a-56ec-401b-b0db-4c1ca20db83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:25 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7 1073741824
Jun 24 04:23:25 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04df2025-fa43-466c-a134-42cb191906b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:25 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Volume volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a (16fd9790-c51a-4001-8b1f-886a8fb58b8a): created successfully
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04df2025-fa43-466c-a134-42cb191906b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Flow 'volume_create_manager' (9bc7fc02-4d8f-485c-9a63-5b9b417f9248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:25 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-c290f6e7-c412-4491-b690-3c20331db040 req-18cc67da-21ad-457a-8fd7-09c6bb7db035 tempest-VolumesSnapshotsTestJSON-1424976758 None] Created volume successfully.
Jun 24 04:23:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:26 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7 1073741824" returned: 0 in 1.403s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:26 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7
Jun 24 04:23:26 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:26 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Flow 'volume_create_manager' (9c923285-beb1-4694-b323-697c46e629ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2bb8e3-db00-4e48-9d7f-27a1bdc41102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2bb8e3-db00-4e48-9d7f-27a1bdc41102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1627036394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f136b6f-e53f-4649-aeda-3ad12b79be6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1412aa953444f6903634c88700067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:27Z,use_quota=True,user_id='d30bf9a173234481ac48387c26c7c5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878b0e11-a7e7-4c72-98e5-d2ae1551583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878b0e11-a7e7-4c72-98e5-d2ae1551583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b681ec6-f21a-4dab-8458-c3b05baf246b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b681ec6-f21a-4dab-8458-c3b05baf246b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f136b6f-e53f-4649-aeda-3ad12b79be6b', 'volume_name': 'volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657f5f2d-7801-40bc-af7c-7b879fd74698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657f5f2d-7801-40bc-af7c-7b879fd74698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a086c0c-c6a2-4b3f-b303-0f4ccf332b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:27 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Volume 8f136b6f-e53f-4649-aeda-3ad12b79be6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b', 'volume_size': 1}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:27 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7" returned: 0 in 0.844s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.208s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Creating offline snapshot ed6cabc0-e8af-4fa4-b93b-44720eb49c17 of volume 16fd9790-c51a-4001-8b1f-886a8fb58b8a {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a22b531-1c6a-4f63-935c-6908ce636892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093df1dd-5421-4965-8056-e22df2189142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c4c502-78cc-4d3a-916d-87a274217dd3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:27 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Volume volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7 (e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7): created successfully
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093df1dd-5421-4965-8056-e22df2189142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Flow 'volume_create_manager' (f4e36d1f-e8ba-4500-8053-1a1158c00dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8e8c021c-7941-41ea-8972-919f03f02868 tempest-CreateVolumesFromImageTest-1777246095 None] Created volume successfully.
Jun 24 04:23:27 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a
Jun 24 04:23:27 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-quobyte-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:28 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13709e-cb82-4faf-a514-2619c3a7cfb7]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:28 devstack sudo[105687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7
Jun 24 04:23:28 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:28 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a" returned: 0 in 0.859s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:28 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 1G
Jun 24 04:23:28 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:29 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7" returned: 0 in 0.912s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:29 devstack sudo[105699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7
Jun 24 04:23:29 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:29 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 1G" returned: 0 in 0.922s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:29 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17
Jun 24 04:23:29 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:30 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7" returned: 0 in 0.768s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7" released by "delete_volume" :: held 1.730s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Created reservations ['5db12527-f743-4654-8bae-d29f8facb315', '65d1b5a1-32bd-4555-a01d-911a781e9399', 'd8126cc3-3372-4925-a208-0a715bf6d9ab', 'e51a47c8-9d57-49e7-b3df-ca3616ef4861'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:30 devstack sudo[105708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:30 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:30 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17" returned: 0 in 0.899s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:30 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 is being set with open permissions: ugo+rw
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:30 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17
Jun 24 04:23:30 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-quobyte-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab" acquired by "delete_volume" :: waited 0.040s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c177df17-fdae-4aa6-96ee-810aff5b8e75]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:31 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab
Jun 24 04:23:31 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:31 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.934s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:31 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:31 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Deleted volume successfully.
Jun 24 04:23:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9bfb075e-fc76-4d08-aad3-83ed242c5bff tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-e462bcfc-cfff-414a-b5e9-a8c8c1fdf9e7-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:31 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17" returned: 0 in 0.973s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:31 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.info
Jun 24 04:23:31 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:31 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab" returned: 0 in 1.150s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:32 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab
Jun 24 04:23:32 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:32 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.info" returned: 0 in 0.771s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:32 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.info is being set with open permissions: ugo+rw
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:32 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.info
Jun 24 04:23:32 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:32 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab" returned: 0 in 0.754s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab" released by "delete_volume" :: held 1.972s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Created reservations ['9f5769ed-fc4a-41e0-9f45-159593684210', '4204b34b-bb7a-42b8-93dd-7ff1f45ab43c', '213818e5-54ac-4075-bd73-c1b2b699d324', 'dca62c01-4583-4ac0-9a8b-42b1a008afea'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:32 devstack sudo[105728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:32 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:33 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.info" returned: 0 in 0.852s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.396s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.014s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1627036394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f136b6f-e53f-4649-aeda-3ad12b79be6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1412aa953444f6903634c88700067d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:27Z,use_quota=True,user_id='d30bf9a173234481ac48387c26c7c5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Creating volume 8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:33 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:33 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b 1073741824
Jun 24 04:23:33 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-92b6fa4e-d4d0-42a4-9720-138dfa34d19d req-4261a12b-fa41-46a9-81b0-20ecdcb84f71 tempest-VolumesSnapshotsTestJSON-1424976758 None] Create snapshot completed successfully
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-quobyte-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f97e8a1-f0bc-4679-84f6-4cca5d502644]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:33 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15
Jun 24 04:23:33 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "cinder-ed6cabc0-e8af-4fa4-b93b-44720eb49c17-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-ed6cabc0-e8af-4fa4-b93b-44720eb49c17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "cinder-quobyte-16fd9790-c51a-4001-8b1f-886a8fb58b8a" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-quobyte-16fd9790-c51a-4001-8b1f-886a8fb58b8a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "cinder-quobyte-ed6cabc0-e8af-4fa4-b93b-44720eb49c17" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-quobyte-ed6cabc0-e8af-4fa4-b93b-44720eb49c17" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Deleting offline snapshot ed6cabc0-e8af-4fa4-b93b-44720eb49c17 of volume 16fd9790-c51a-4001-8b1f-886a8fb58b8a {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] snapshot_file for this snap is: volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[18025856-1bec-4af2-aa53-7ea0d0f898af]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:33 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17
Jun 24 04:23:33 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:34 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.131s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:34 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Deleted volume successfully.
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1cd6ca24-106b-47de-be90-96311db1e7b9 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-5ce2f447-1ef2-4ea0-b6ce-060201bd1cab-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:34 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b 1073741824" returned: 0 in 1.190s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:34 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15" returned: 0 in 1.086s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:34 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15
Jun 24 04:23:34 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:34 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:23:34 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:34 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17" returned: 0 in 1.048s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f964e6-0b29-452e-a0c3-08ecece76e16]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:35 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a
Jun 24 04:23:35 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:35 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15" returned: 0 in 0.875s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15" released by "delete_volume" :: held 2.041s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:35 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 1.054s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Created reservations ['dc432882-bf40-4e96-bbf6-14e5add83bb2', 'c7e5144b-4960-44e9-8199-f9c473182301', '753a937a-90ca-480d-89bf-ee22eecfac37', '66bf550d-0306-4027-930a-33f4246d96ce'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a086c0c-c6a2-4b3f-b303-0f4ccf332b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab046de6-fd10-4cae-b7dc-e3ac32358fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:35 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Volume volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b (8f136b6f-e53f-4649-aeda-3ad12b79be6b): created successfully
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab046de6-fd10-4cae-b7dc-e3ac32358fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Flow 'volume_create_manager' (9c923285-beb1-4694-b323-697c46e629ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:35 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ea73d1ce-e8f9-456b-88d2-1b724e6b50ec tempest-VolumesActionsTest-1911343014 None] Created volume successfully.
Jun 24 04:23:35 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a" returned: 0 in 1.079s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:35 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17
Jun 24 04:23:35 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:36 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:36 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-f3f9a258-4114-4c4e-9f7a-24de106f0476-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-f3f9a258-4114-4c4e-9f7a-24de106f0476-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:36 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17" returned: 0 in 0.867s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:36 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17
Jun 24 04:23:36 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:36 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.679s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:36 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:36 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Deleted volume successfully.
Jun 24 04:23:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c7ac770b-a2c2-48a1-a486-d52849630b33 tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-23cb1acb-15d2-4ed2-96b9-d0ddcfd3cd15-delete_volume" released by "delete_volume" :: held 4.036s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-quobyte-f3f9a258-4114-4c4e-9f7a-24de106f0476" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-f3f9a258-4114-4c4e-9f7a-24de106f0476" acquired by "delete_volume" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ad77f1-b560-4f38-8ff8-711b5e82b94f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:37 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476
Jun 24 04:23:37 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:37 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a.ed6cabc0-e8af-4fa4-b93b-44720eb49c17" returned: 0 in 0.848s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-quobyte-ed6cabc0-e8af-4fa4-b93b-44720eb49c17" released by "_delete_snapshot" :: held 4.052s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-quobyte-16fd9790-c51a-4001-8b1f-886a8fb58b8a" released by "delete_snapshot" :: held 4.099s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:38 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476" returned: 0 in 0.941s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:38 devstack cinder-volume[93470]: DEBUG cinder.quota [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Created reservations ['8eed9870-80bc-467a-9124-0c175e75385c', 'd6e0e4e0-4090-486e-b72f-c3b4a906aeeb', '1ed469b3-1a55-4f22-8029-80159162e969', 'f987d9fa-aa95-4151-a130-d243d40129a8'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:38 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476
Jun 24 04:23:38 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Delete snapshot completed successfully.
Jun 24 04:23:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-4aa5ae9e-4524-4481-95e3-e86c2133fa05 req-6ff39256-efab-4745-9b2d-82704a191b23 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-ed6cabc0-e8af-4fa4-b93b-44720eb49c17-delete_snapshot" released by "delete_snapshot" :: held 4.919s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:38 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f3f9a258-4114-4c4e-9f7a-24de106f0476" returned: 0 in 0.716s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-f3f9a258-4114-4c4e-9f7a-24de106f0476" released by "delete_volume" :: held 1.718s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Created reservations ['32e04209-e555-4049-baa7-cf64751b26f1', '8f5c62d2-c3b9-4aa5-b8f0-9ccffa81b8df', '80d9b5b6-f8a0-4aa7-961d-b41c979e379b', '26500510-78e4-459f-9e6f-f3339ec8dccf'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "cinder-16fd9790-c51a-4001-8b1f-886a8fb58b8a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-16fd9790-c51a-4001-8b1f-886a8fb58b8a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:39 devstack sudo[105783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:39 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "cinder-quobyte-16fd9790-c51a-4001-8b1f-886a8fb58b8a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-quobyte-16fd9790-c51a-4001-8b1f-886a8fb58b8a" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea93750-0858-4f62-bf76-4e046fd985cf]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:40 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a
Jun 24 04:23:40 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:40 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.687s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Deleted volume successfully.
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d431b754-5921-4a3d-b7b7-2c26855d11fe tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-f3f9a258-4114-4c4e-9f7a-24de106f0476-delete_volume" released by "delete_volume" :: held 3.868s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-1e226317-c361-4797-a898-d5c6cb601033-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:40 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a" returned: 0 in 0.954s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-1e226317-c361-4797-a898-d5c6cb601033-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:40 devstack sudo[105791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a
Jun 24 04:23:40 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "cinder-quobyte-1e226317-c361-4797-a898-d5c6cb601033" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-1e226317-c361-4797-a898-d5c6cb601033" acquired by "delete_volume" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:41 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7959cc92-3027-44e9-9f85-020b2af1bc18]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:41 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033
Jun 24 04:23:41 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:41 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-16fd9790-c51a-4001-8b1f-886a8fb58b8a" returned: 0 in 1.023s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-quobyte-16fd9790-c51a-4001-8b1f-886a8fb58b8a" released by "delete_volume" :: held 2.075s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:41 devstack cinder-volume[93470]: DEBUG cinder.quota [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Created reservations ['2d1f862d-012b-4224-973c-c2803bf07091', 'bb9759cc-2788-4950-9350-cda1ce02e302', '702f05f7-c55f-499f-99e9-c890bfd30c30', '85137b67-ddeb-46cb-916c-8f511a6ea5b2'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:42 devstack sudo[105800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:42 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:42 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033" returned: 0 in 1.140s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:42 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033
Jun 24 04:23:42 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:43 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1e226317-c361-4797-a898-d5c6cb601033" returned: 0 in 0.916s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-quobyte-1e226317-c361-4797-a898-d5c6cb601033" released by "delete_volume" :: held 2.178s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=106,cinder:INSERT=47,cinder:UPDATE=168,cinder:DELETE=11 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:23:43 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.091s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG cinder.manager [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Deleted volume successfully.
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-92d05cdb-3eb8-4c1a-a359-568cbbced46c req-63f586d1-72fe-42c4-8451-8125b878bea3 tempest-VolumesSnapshotsTestJSON-1424976758 None] Lock "cinder-16fd9790-c51a-4001-8b1f-886a8fb58b8a-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Created reservations ['ac72ce17-0001-4db1-8216-b697f8149bf7', 'b34008f8-29f1-4483-a530-3796e7148f61', 'eb11201b-78bf-4711-9b09-32929bb5a959', 'e649cfab-c950-4c13-86d6-a435d91b767c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:43 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:43 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:44 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.873s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:44 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:44 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Deleted volume successfully.
Jun 24 04:23:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b30aecc8-e5f1-4e86-aa1f-00c2cad3160b tempest-CreateVolumesFromImageTest-1777246095 None] Lock "cinder-1e226317-c361-4797-a898-d5c6cb601033-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:23:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:45 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:23:45 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:46 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.163s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:23:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:23:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:INSERT=31,cinder:UPDATE=166,cinder:SELECT=120,cinder:DELETE=17 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (1dbd7d6b-cfc2-4a9f-8e97-37109087a8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29e1790-02b2-44a7-a38b-d811c5de605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29e1790-02b2-44a7-a38b-d811c5de605f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1159201741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5aae89-74aa-4705-92d4-582c05e95b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:50Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395bedd0-cde7-4358-9839-37822e335c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395bedd0-cde7-4358-9839-37822e335c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97255552-658f-4abd-b3e1-4d117f67545f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97255552-658f-4abd-b3e1-4d117f67545f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5aae89-74aa-4705-92d4-582c05e95b96', 'volume_name': 'volume-bf5aae89-74aa-4705-92d4-582c05e95b96', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352cf2ba-31c7-4e0a-a4e9-1cd0a04466ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352cf2ba-31c7-4e0a-a4e9-1cd0a04466ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb34e5c-f37a-4461-ac97-57a1806bdaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume bf5aae89-74aa-4705-92d4-582c05e95b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5aae89-74aa-4705-92d4-582c05e95b96', 'volume_size': 1}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1159201741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5aae89-74aa-4705-92d4-582c05e95b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:50Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Creating volume bf5aae89-74aa-4705-92d4-582c05e95b96 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:49 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:49 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96 1073741824
Jun 24 04:23:49 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b883a014-7fd6-4d87-b4c2-a5f70956620e tempest-BackendsCapabilitiesAdminTestsJSON-2131116263 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93470) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 24 04:23:50 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96 1073741824" returned: 0 in 0.879s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:50 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96
Jun 24 04:23:50 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fe71ed23-735a-48c4-957c-2166a9a9058e tempest-BackendsCapabilitiesAdminTestsJSON-2131116263 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93470) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 24 04:23:51 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96" returned: 0 in 0.748s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb34e5c-f37a-4461-ac97-57a1806bdaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5aae89-74aa-4705-92d4-582c05e95b96', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc834ea8-18b8-4de3-a537-5b041a3f30fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:51 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume volume-bf5aae89-74aa-4705-92d4-582c05e95b96 (bf5aae89-74aa-4705-92d4-582c05e95b96): created successfully
Jun 24 04:23:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc834ea8-18b8-4de3-a537-5b041a3f30fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (1dbd7d6b-cfc2-4a9f-8e97-37109087a8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-874faa43-310f-44ce-836f-a1713cea2385 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created volume successfully.
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (4946e49a-9ad0-4d34-a12d-7db10b3d2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a99e099-db59-4681-8453-2d5924f25512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a99e099-db59-4681-8453-2d5924f25512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669589867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e53589b-b385-4aec-8f18-bbf6c97a2a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:53Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f374f9-7630-48c8-b04f-fdf6301e41cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f374f9-7630-48c8-b04f-fdf6301e41cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb693e3-88ba-4004-83ae-fe75d176585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb693e3-88ba-4004-83ae-fe75d176585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e53589b-b385-4aec-8f18-bbf6c97a2a96', 'volume_name': 'volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d942ac56-c65d-4e8f-967a-a154b6aa96b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d942ac56-c65d-4e8f-967a-a154b6aa96b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7376b02e-d013-461d-84c6-f2e3aeeb82dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume 9e53589b-b385-4aec-8f18-bbf6c97a2a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96', 'volume_size': 1}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669589867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e53589b-b385-4aec-8f18-bbf6c97a2a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:53Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Creating volume 9e53589b-b385-4aec-8f18-bbf6c97a2a96 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:53 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:53 devstack sudo[105847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96 1073741824
Jun 24 04:23:53 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (5a4b0a00-1909-44a5-9ab8-3db423a57f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbd592f-3064-4300-9a00-69dd4fab32da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbd592f-3064-4300-9a00-69dd4fab32da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1078462095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0204b978-35cf-413c-be3d-47950bbd2bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:54Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52670d99-7adc-43af-9bcd-841b940dc432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52670d99-7adc-43af-9bcd-841b940dc432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08aa3452-3e44-4abc-be1c-3a9958c6f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08aa3452-3e44-4abc-be1c-3a9958c6f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0204b978-35cf-413c-be3d-47950bbd2bb6', 'volume_name': 'volume-0204b978-35cf-413c-be3d-47950bbd2bb6', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959e3e51-3df8-48dd-958e-9bacf9b130b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959e3e51-3df8-48dd-958e-9bacf9b130b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f413c41-23e0-4057-8874-f17ed0951a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume 0204b978-35cf-413c-be3d-47950bbd2bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0204b978-35cf-413c-be3d-47950bbd2bb6', 'volume_size': 1}
Jun 24 04:23:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (db118a74-5b08-4077-848d-0eb46a450b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1424a6-4efa-4fba-8d08-8984339476ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1424a6-4efa-4fba-8d08-8984339476ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128416277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d45411-4f11-41ce-9bbc-b5b8e919cf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:54Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734120d5-bc5f-4bc2-b3c2-3f937e11ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734120d5-bc5f-4bc2-b3c2-3f937e11ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda69476-027b-45c3-85d0-55763c2599c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda69476-027b-45c3-85d0-55763c2599c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d45411-4f11-41ce-9bbc-b5b8e919cf55', 'volume_name': 'volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043b544a-f867-49f1-b183-3510a654c405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043b544a-f867-49f1-b183-3510a654c405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305161d5-7d04-4a20-821d-cd53359a8b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:54 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume 78d45411-4f11-41ce-9bbc-b5b8e919cf55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55', 'volume_size': 1}
Jun 24 04:23:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:55 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96 1073741824" returned: 0 in 1.723s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (500f5232-bd14-43c8-8185-89fd1315a1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ce59f9-c172-4a5b-bb0c-f49018c44b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ce59f9-c172-4a5b-bb0c-f49018c44b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99717180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34153d3f-ba2f-4018-b8d0-6d6067889342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:55Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8021a478-31ad-4936-8164-adf2751b0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8021a478-31ad-4936-8164-adf2751b0e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ce47ae-2f78-4337-a950-c0b33d9b0fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ce47ae-2f78-4337-a950-c0b33d9b0fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34153d3f-ba2f-4018-b8d0-6d6067889342', 'volume_name': 'volume-34153d3f-ba2f-4018-b8d0-6d6067889342', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f20c56-1595-4389-a7a9-581f468e219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f20c56-1595-4389-a7a9-581f468e219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87411883-05dd-4663-b0ce-073b03cfb451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:55 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume 34153d3f-ba2f-4018-b8d0-6d6067889342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34153d3f-ba2f-4018-b8d0-6d6067889342', 'volume_size': 1}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:55 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96
Jun 24 04:23:55 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (98d21f13-d253-46e5-b242-1d8b0a0395c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9bd279-e5ca-4922-9f35-f4e4daecc562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9bd279-e5ca-4922-9f35-f4e4daecc562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955930874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:56Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f547035c-77c0-4588-8cb9-89072802d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f547035c-77c0-4588-8cb9-89072802d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faef4734-08f5-4b7c-a342-7d56a793d9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faef4734-08f5-4b7c-a342-7d56a793d9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4', 'volume_name': 'volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e32b1d-c7fc-4cef-95b7-466d9e3115d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e32b1d-c7fc-4cef-95b7-466d9e3115d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719323dc-648a-4012-8571-14ebc6895937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:56 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4', 'volume_size': 1}
Jun 24 04:23:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:57 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96" returned: 0 in 2.160s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] <== create_volume: return (4225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.228s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.729s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1078462095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0204b978-35cf-413c-be3d-47950bbd2bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:54Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Creating volume 0204b978-35cf-413c-be3d-47950bbd2bb6 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:57 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:57 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6 1073741824
Jun 24 04:23:57 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7376b02e-d013-461d-84c6-f2e3aeeb82dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b559a827-97ab-4087-8453-ba478a1fa24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:57 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96 (9e53589b-b385-4aec-8f18-bbf6c97a2a96): created successfully
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b559a827-97ab-4087-8453-ba478a1fa24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (4946e49a-9ad0-4d34-a12d-7db10b3d2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:57 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a10be333-2954-4b0d-9c06-7ff782ee1c4e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created volume successfully.
Jun 24 04:23:59 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6 1073741824" returned: 0 in 1.744s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:59 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6
Jun 24 04:23:59 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:00 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6" returned: 0 in 1.344s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] <== create_volume: return (3155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.158s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.171s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128416277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d45411-4f11-41ce-9bbc-b5b8e919cf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:54Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Creating volume 78d45411-4f11-41ce-9bbc-b5b8e919cf55 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:24:00 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:00 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55 1073741824
Jun 24 04:24:00 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f413c41-23e0-4057-8874-f17ed0951a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0204b978-35cf-413c-be3d-47950bbd2bb6', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db6e82d-75c5-4ed3-92a2-964d948a161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume volume-0204b978-35cf-413c-be3d-47950bbd2bb6 (0204b978-35cf-413c-be3d-47950bbd2bb6): created successfully
Jun 24 04:24:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db6e82d-75c5-4ed3-92a2-964d948a161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:01 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (5a4b0a00-1909-44a5-9ab8-3db423a57f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f74e6458-37fd-4f76-876d-e3a3b7d02a77 tempest-VolumesActionsTest-1911343014 None] Acquiring lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b" by "attach_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c6c4b8a5-30d1-43c4-bac6-b31a66f813da tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created volume successfully.
Jun 24 04:24:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f74e6458-37fd-4f76-876d-e3a3b7d02a77 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b" acquired by "attach_volume" :: waited 0.054s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-644d9580-5f98-4c9e-82fb-ecb5d548b85c tempest-GroupsV314Test-1666145562 None] Group tempest-GroupsV314Test-Group-822414217: creating
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-644d9580-5f98-4c9e-82fb-ecb5d548b85c tempest-GroupsV314Test-1666145562 None] Group tempest-GroupsV314Test-Group-822414217: created successfully
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f74e6458-37fd-4f76-876d-e3a3b7d02a77 tempest-VolumesActionsTest-1911343014 None] Attaching volume 8f136b6f-e53f-4649-aeda-3ad12b79be6b to instance bbee6c9e-5d2f-4c9d-85d5-c8c9fdfb6b5e at mountpoint /dev/vdb on host None.
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-644d9580-5f98-4c9e-82fb-ecb5d548b85c tempest-GroupsV314Test-1666145562 None] Create group completed successfully.
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f74e6458-37fd-4f76-876d-e3a3b7d02a77 tempest-VolumesActionsTest-1911343014 None] Attach volume completed successfully.
Jun 24 04:24:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f74e6458-37fd-4f76-876d-e3a3b7d02a77 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b" released by "attach_volume" :: held 0.177s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eba7d47d-36d1-4051-9a73-cace28e2e9f4 tempest-VolumesActionsTest-1911343014 None] Acquiring lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-detach_volume" by "detach_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eba7d47d-36d1-4051-9a73-cace28e2e9f4 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-eba7d47d-36d1-4051-9a73-cace28e2e9f4 tempest-VolumesActionsTest-1911343014 None] Detaching volume 8f136b6f-e53f-4649-aeda-3ad12b79be6b from instance bbee6c9e-5d2f-4c9d-85d5-c8c9fdfb6b5e.
Jun 24 04:24:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-eba7d47d-36d1-4051-9a73-cace28e2e9f4 tempest-VolumesActionsTest-1911343014 None] Detach volume completed successfully.
Jun 24 04:24:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eba7d47d-36d1-4051-9a73-cace28e2e9f4 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:02 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55 1073741824" returned: 0 in 1.266s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:02 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55
Jun 24 04:24:02 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:03 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55" returned: 0 in 1.026s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.772s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99717180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34153d3f-ba2f-4018-b8d0-6d6067889342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:55Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Creating volume 34153d3f-ba2f-4018-b8d0-6d6067889342 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:24:03 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305161d5-7d04-4a20-821d-cd53359a8b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dd1578-26cd-4200-a3f7-0e3081de347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:03 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342 1073741824
Jun 24 04:24:03 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55 (78d45411-4f11-41ce-9bbc-b5b8e919cf55): created successfully
Jun 24 04:24:03 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dd1578-26cd-4200-a3f7-0e3081de347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (db118a74-5b08-4077-848d-0eb46a450b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:03 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b6f548d1-e703-4521-b669-d081e7fc09cc tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created volume successfully.
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Flow 'volume_create_manager' (ab836d26-55b8-49b1-9132-666afe8bb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b568e424-8455-468b-a47f-b1cd59b85773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b568e424-8455-468b-a47f-b1cd59b85773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1482020263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=46293936-34a9-4ee9-b904-d9dc7500aa7e,host='devstack@QuobyteHD#QuobyteHD',id=73c28f93-db57-48f4-9630-6ca31fc86a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e1d32c490545058591b5087f5160dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:03Z,use_quota=True,user_id='97883f2acd254ae18eb0f3120643d70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02c1428e-1a29-41d5-9be7-4594d82565d2),volume_type_id=02c1428e-1a29-41d5-9be7-4594d82565d2)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed070419-d4dc-43a7-ab64-cdbd35f2de4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed070419-d4dc-43a7-ab64-cdbd35f2de4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e458b1e0-eea5-465c-95cb-a9209dd5343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e458b1e0-eea5-465c-95cb-a9209dd5343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c28f93-db57-48f4-9630-6ca31fc86a0f', 'volume_name': 'volume-73c28f93-db57-48f4-9630-6ca31fc86a0f', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845474b5-fe3f-4398-b0d6-fe3929f7e983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845474b5-fe3f-4398-b0d6-fe3929f7e983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d226169-d3fa-4574-8d35-789c8098290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:03 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Volume 73c28f93-db57-48f4-9630-6ca31fc86a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c28f93-db57-48f4-9630-6ca31fc86a0f', 'volume_size': 1}
Jun 24 04:24:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:04 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342 1073741824" returned: 0 in 1.241s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:04 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342
Jun 24 04:24:04 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:05 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342" returned: 0 in 0.699s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.790s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1955930874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3438e90f4f3436999b700d7c749c589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:56Z,use_quota=True,user_id='e75962d516d14193b46eeacc3c3da489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Creating volume b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:24:05 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87411883-05dd-4663-b0ce-073b03cfb451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34153d3f-ba2f-4018-b8d0-6d6067889342', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:05 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4 1073741824
Jun 24 04:24:05 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d27ab2d-7d7a-43e0-8d36-8834fd25dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:05 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume volume-34153d3f-ba2f-4018-b8d0-6d6067889342 (34153d3f-ba2f-4018-b8d0-6d6067889342): created successfully
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d27ab2d-7d7a-43e0-8d36-8834fd25dd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (500f5232-bd14-43c8-8185-89fd1315a1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:05 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2ea4a407-924d-40ae-b408-117651bf8be0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created volume successfully.
Jun 24 04:24:06 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4 1073741824" returned: 0 in 1.050s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:06 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4
Jun 24 04:24:06 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:07 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4" returned: 0 in 1.219s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=46293936-34a9-4ee9-b904-d9dc7500aa7e,created_at=2026-06-24T02:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1482020263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=46293936-34a9-4ee9-b904-d9dc7500aa7e,host='devstack@QuobyteHD#QuobyteHD',id=73c28f93-db57-48f4-9630-6ca31fc86a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e1d32c490545058591b5087f5160dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:03Z,use_quota=True,user_id='97883f2acd254ae18eb0f3120643d70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02c1428e-1a29-41d5-9be7-4594d82565d2),volume_type_id=02c1428e-1a29-41d5-9be7-4594d82565d2)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Creating volume 73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:24:07 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719323dc-648a-4012-8571-14ebc6895937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:07 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f 1073741824
Jun 24 04:24:07 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c22917f-5e00-4f02-b60e-4b26b706e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:07 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Volume volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4 (b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4): created successfully
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c22917f-5e00-4f02-b60e-4b26b706e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Flow 'volume_create_manager' (98d21f13-d253-46e5-b242-1d8b0a0395c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:07 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6fd4abd0-2e7b-4a54-8afc-c3e263ba0ba0 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created volume successfully.
Jun 24 04:24:08 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f 1073741824" returned: 0 in 0.980s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:08 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f
Jun 24 04:24:08 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-quobyte-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4" acquired by "delete_volume" :: waited 0.047s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa5f83f-cb91-46b5-bdff-c73cedc16c41]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:09 devstack sudo[106174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4
Jun 24 04:24:09 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:09 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f" returned: 0 in 1.022s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d226169-d3fa-4574-8d35-789c8098290d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c28f93-db57-48f4-9630-6ca31fc86a0f', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8556aec3-408d-462a-b0d9-d8c024143da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:09 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Volume volume-73c28f93-db57-48f4-9630-6ca31fc86a0f (73c28f93-db57-48f4-9630-6ca31fc86a0f): created successfully
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8556aec3-408d-462a-b0d9-d8c024143da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Flow 'volume_create_manager' (ab836d26-55b8-49b1-9132-666afe8bb40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:09 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-302341ba-1633-4a0a-9262-ca3c7b48d81d tempest-GroupsV314Test-1666145562 None] Created volume successfully.
Jun 24 04:24:10 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4" returned: 0 in 1.102s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:10 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4
Jun 24 04:24:10 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:11 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4" returned: 0 in 1.012s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4" released by "delete_volume" :: held 2.195s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created reservations ['407b1884-5a69-4ebb-a7e7-46cbf78872c9', '7a721916-2230-4af2-993f-1e1507c04369', 'd7d42c04-5197-4dc8-a051-9f22a33d231f', '797e8e77-9bad-408d-a161-c589917688cf'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:11 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:11 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:12 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Cloning volume 73c28f93-db57-48f4-9630-6ca31fc86a0f to volume d570203b-bdba-4408-b07c-59117fc0f91f
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Creating offline snapshot f8eb620e-1203-4cd0-9d17-30c201558fa8 of volume 73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0f26ae-6d53-4417-875c-62aea15a6b2f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:12 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f
Jun 24 04:24:12 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-34153d3f-ba2f-4018-b8d0-6d6067889342-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-34153d3f-ba2f-4018-b8d0-6d6067889342-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:12 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.506s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:12 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Deleted volume successfully.
Jun 24 04:24:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-quobyte-34153d3f-ba2f-4018-b8d0-6d6067889342" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e3d1e27c-df1b-44a0-a864-40969dfa97d2 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-b0d7c2b9-e5ed-449d-a8bd-f9e4a3b17de4-delete_volume" released by "delete_volume" :: held 4.135s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-34153d3f-ba2f-4018-b8d0-6d6067889342" acquired by "delete_volume" :: waited 0.108s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Flow 'volume_create_manager' (03231d53-a264-4797-a285-df1ae772d43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aedcfbd-ed25-46e5-9d9b-a2f26833f8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ca2847-0bfb-4408-8b78-1d5b6d66a159]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aedcfbd-ed25-46e5-9d9b-a2f26833f8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-561640388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5a6dec-975a-407c-b8cb-a05785852cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ec4a31bb2d41fe817a16c637829a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:13Z,use_quota=True,user_id='503ae08506a342f5acdf0257f55266a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3fea9f-cef7-466e-accf-5b0d12d6d215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3fea9f-cef7-466e-accf-5b0d12d6d215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f657bb-bc87-4d06-9d74-8c4d23791d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f657bb-bc87-4d06-9d74-8c4d23791d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b5a6dec-975a-407c-b8cb-a05785852cad', 'volume_name': 'volume-8b5a6dec-975a-407c-b8cb-a05785852cad', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7e6bc2-ffa6-4439-887d-4c147638e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7e6bc2-ffa6-4439-887d-4c147638e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b4606a-6c8c-4811-9b18-c9f2deb68f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:13 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Volume 8b5a6dec-975a-407c-b8cb-a05785852cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b5a6dec-975a-407c-b8cb-a05785852cad', 'volume_size': 1}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:13 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342
Jun 24 04:24:13 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:13 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f" returned: 0 in 1.574s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:13 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 1G
Jun 24 04:24:13 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:14 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342" returned: 0 in 1.022s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:14 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342
Jun 24 04:24:14 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:14 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 1G" returned: 0 in 1.042s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c28f93-db57-48f4-9630-6ca31fc86a0f -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:14 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c28f93-db57-48f4-9630-6ca31fc86a0f -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8
Jun 24 04:24:14 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:15 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-34153d3f-ba2f-4018-b8d0-6d6067889342" returned: 0 in 0.784s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-34153d3f-ba2f-4018-b8d0-6d6067889342" released by "delete_volume" :: held 1.955s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created reservations ['e8e61a23-d4ea-4f21-839a-37de8516cc9b', 'b712efcc-eacd-4494-8528-05d9b3574163', '62b96819-9b45-4701-917e-b7d706dcce89', '31efb12b-4821-432e-a4ad-cce2348a4ff5'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:15 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:15 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:15 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c28f93-db57-48f4-9630-6ca31fc86a0f -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8" returned: 0 in 0.900s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:15 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:24:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:15 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8
Jun 24 04:24:15 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:16 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.829s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:16 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Deleted volume successfully.
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0622a6cc-8963-4b0c-a198-c1236bdb160a tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-34153d3f-ba2f-4018-b8d0-6d6067889342-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-78d45411-4f11-41ce-9bbc-b5b8e919cf55-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-78d45411-4f11-41ce-9bbc-b5b8e919cf55-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-quobyte-78d45411-4f11-41ce-9bbc-b5b8e919cf55" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-78d45411-4f11-41ce-9bbc-b5b8e919cf55" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4016ca06-3343-46ed-bd9b-0435500b542a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:16 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55
Jun 24 04:24:16 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:16 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8" returned: 0 in 0.772s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:16 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.info
Jun 24 04:24:16 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:17 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55" returned: 0 in 0.868s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:17 devstack sudo[106265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55
Jun 24 04:24:17 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:17 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.info" returned: 0 in 0.901s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:17 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:24:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:17 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.info
Jun 24 04:24:17 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:18 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-78d45411-4f11-41ce-9bbc-b5b8e919cf55" returned: 0 in 0.970s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-78d45411-4f11-41ce-9bbc-b5b8e919cf55" released by "delete_volume" :: held 1.901s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created reservations ['196a8f62-46f7-4d8b-8b17-bb67f1750228', '0d29dcb5-80f1-4cf5-b14c-35be6defbe48', 'e636eb7f-4d74-43e4-b80c-c7d5e28f6de8', '4583c108-af0b-428c-838c-32452fbb2df5'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:18 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:18 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:18 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.info" returned: 0 in 1.080s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Acquiring lock "cinder-quobyte-d570203b-bdba-4408-b07c-59117fc0f91f" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Lock "cinder-quobyte-d570203b-bdba-4408-b07c-59117fc0f91f" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] snapshot: f8eb620e-1203-4cd0-9d17-30c201558fa8, volume: d570203b-bdba-4408-b07c-59117fc0f91f,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-0204b978-35cf-413c-be3d-47950bbd2bb6-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d12ad1-e61f-4595-b7d0-73dc3b1629a6]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-0204b978-35cf-413c-be3d-47950bbd2bb6-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-quobyte-0204b978-35cf-413c-be3d-47950bbd2bb6" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-0204b978-35cf-413c-be3d-47950bbd2bb6" acquired by "delete_volume" :: waited 0.038s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:19 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[65824391-fe24-4d3c-894d-7aab93124662]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:19 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8
Jun 24 04:24:19 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:19 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6
Jun 24 04:24:19 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:20 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.717s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:20 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Deleted volume successfully.
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-86d39575-b340-4240-9c33-6c3f25944f43 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-78d45411-4f11-41ce-9bbc-b5b8e919cf55-delete_volume" released by "delete_volume" :: held 3.979s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:20 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8" returned: 0 in 1.848s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c28f93-db57-48f4-9630-6ca31fc86a0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6cda10-6d41-40dc-ba30-c81e2d7b80f8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:20 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6" returned: 0 in 1.690s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:20 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6
Jun 24 04:24:20 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:20 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f
Jun 24 04:24:20 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:21 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0204b978-35cf-413c-be3d-47950bbd2bb6" returned: 0 in 0.676s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-0204b978-35cf-413c-be3d-47950bbd2bb6" released by "delete_volume" :: held 2.451s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created reservations ['a3733873-2238-48b9-b137-65f362a69b55', '6b17cfb3-d871-4176-9131-bd396e581bc8', 'bc9df7d9-2e70-42fd-9005-fbdab91c799d', 'afafd03f-073d-49ca-b2cb-38ecf7121a94'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:21 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:21 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:21 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f" returned: 0 in 0.932s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:24:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:21 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f
Jun 24 04:24:21 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:22 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.689s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Deleted volume successfully.
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b8cdc026-35ad-46da-a7b2-f0020d6dc3f7 tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-0204b978-35cf-413c-be3d-47950bbd2bb6-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-9e53589b-b385-4aec-8f18-bbf6c97a2a96-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-9e53589b-b385-4aec-8f18-bbf6c97a2a96-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-quobyte-9e53589b-b385-4aec-8f18-bbf6c97a2a96" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-9e53589b-b385-4aec-8f18-bbf6c97a2a96" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7966d0-2406-4360-8b4d-adf63d470af3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:22 devstack sudo[106345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96
Jun 24 04:24:22 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:24 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96" returned: 0 in 1.947s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:24 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96
Jun 24 04:24:24 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:25 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9e53589b-b385-4aec-8f18-bbf6c97a2a96" returned: 0 in 1.545s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-9e53589b-b385-4aec-8f18-bbf6c97a2a96" released by "delete_volume" :: held 3.554s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:26 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created reservations ['44951c1b-e5c9-4b29-a1ca-3476c3740b7f', '62b940ff-0603-446e-8e48-d6da1b13576b', '0b05bfb7-dbd7-4e69-b54b-125799ae5e7e', '0f600790-613c-41ea-8e73-d8de853c9485'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:26 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:26 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-bf5aae89-74aa-4705-92d4-582c05e95b96-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-bf5aae89-74aa-4705-92d4-582c05e95b96-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "cinder-quobyte-bf5aae89-74aa-4705-92d4-582c05e95b96" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-bf5aae89-74aa-4705-92d4-582c05e95b96" acquired by "delete_volume" :: waited 0.053s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beefb5c-501d-456a-be1d-8bbf6f4cc1d3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:27 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.439s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Deleted volume successfully.
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0908dfd7-7414-4598-82de-7d9559c7c40e tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-9e53589b-b385-4aec-8f18-bbf6c97a2a96-delete_volume" released by "delete_volume" :: held 5.383s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f" returned: 0 in 6.154s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:27 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96
Jun 24 04:24:27 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed233b4-5201-43b3-b42a-50686679e3f2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:27 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f
Jun 24 04:24:27 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96" returned: 0 in 1.602s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:29 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:29 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96
Jun 24 04:24:29 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:30 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f" returned: 0 in 2.315s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:24:30 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Converted 1024.00 MB image at 166.33 MB/s
Jun 24 04:24:30 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:30 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f
Jun 24 04:24:30 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:30 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf5aae89-74aa-4705-92d4-582c05e95b96" returned: 0 in 1.193s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-quobyte-bf5aae89-74aa-4705-92d4-582c05e95b96" released by "delete_volume" :: held 2.918s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Created reservations ['9701c4f0-d094-44d2-86b2-3b9d38b9f0d2', '226b6dac-afd9-4a0c-95a5-db9222db5717', '8ce27c2d-a078-41b5-9913-544b3aee2fe4', '1e075c6b-aa21-4f80-9801-e8b82284a817'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:30 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:30 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:31 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f" returned: 0 in 0.931s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Lock "cinder-quobyte-d570203b-bdba-4408-b07c-59117fc0f91f" released by "_copy_volume_from_snapshot" :: held 12.362s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Acquiring lock "cinder-quobyte-f8eb620e-1203-4cd0-9d17-30c201558fa8" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Lock "cinder-quobyte-f8eb620e-1203-4cd0-9d17-30c201558fa8" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Deleting offline snapshot f8eb620e-1203-4cd0-9d17-30c201558fa8 of volume 73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] snapshot_file for this snap is: volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a5ac60-376f-4d62-9bff-f4a70e745cea]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:31 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8
Jun 24 04:24:31 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:31 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.193s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:31 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Deleted volume successfully.
Jun 24 04:24:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-823cfdae-c97b-4346-88d5-db56d61bc7db tempest-CreateVolumesFromSourceVolumeTest-1943249922 None] Lock "cinder-bf5aae89-74aa-4705-92d4-582c05e95b96-delete_volume" released by "delete_volume" :: held 4.559s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:32 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8" returned: 0 in 1.208s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c28f93-db57-48f4-9630-6ca31fc86a0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:24:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[651628f2-d562-469c-9abd-3576072fc713]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:32 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f
Jun 24 04:24:32 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aaadc3-6829-4efe-9e29-3b3fa355478f tempest-VolumesActionsTest-1911343014 None] Acquiring lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b" by "attach_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aaadc3-6829-4efe-9e29-3b3fa355478f tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b" acquired by "attach_volume" :: waited 0.034s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f7aaadc3-6829-4efe-9e29-3b3fa355478f tempest-VolumesActionsTest-1911343014 None] Attaching volume 8f136b6f-e53f-4649-aeda-3ad12b79be6b to instance bae9d657-bf6b-40a7-908e-1c951575f89e at mountpoint /dev/vdb on host None.
Jun 24 04:24:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f7aaadc3-6829-4efe-9e29-3b3fa355478f tempest-VolumesActionsTest-1911343014 None] Attach volume completed successfully.
Jun 24 04:24:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f7aaadc3-6829-4efe-9e29-3b3fa355478f tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b" released by "attach_volume" :: held 0.139s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:33 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f" returned: 0 in 1.222s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-83a74774-a9c1-420f-88d1-5359e7e6a549 tempest-VolumesActionsTest-1911343014 None] Acquiring lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-detach_volume" by "detach_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:33 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8
Jun 24 04:24:33 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-83a74774-a9c1-420f-88d1-5359e7e6a549 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-83a74774-a9c1-420f-88d1-5359e7e6a549 tempest-VolumesActionsTest-1911343014 None] Detaching volume 8f136b6f-e53f-4649-aeda-3ad12b79be6b from instance bae9d657-bf6b-40a7-908e-1c951575f89e.
Jun 24 04:24:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-83a74774-a9c1-420f-88d1-5359e7e6a549 tempest-VolumesActionsTest-1911343014 None] Detach volume completed successfully.
Jun 24 04:24:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-83a74774-a9c1-420f-88d1-5359e7e6a549 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:34 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8" returned: 0 in 1.092s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:34 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8
Jun 24 04:24:34 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:35 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f.f8eb620e-1203-4cd0-9d17-30c201558fa8" returned: 0 in 0.977s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Lock "cinder-quobyte-f8eb620e-1203-4cd0-9d17-30c201558fa8" released by "_delete_snapshot" :: held 4.675s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.676s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.529s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-561640388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5a6dec-975a-407c-b8cb-a05785852cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ec4a31bb2d41fe817a16c637829a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:13Z,use_quota=True,user_id='503ae08506a342f5acdf0257f55266a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Creating volume 8b5a6dec-975a-407c-b8cb-a05785852cad {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:24:35 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:24:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:35 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad 1073741824
Jun 24 04:24:35 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:36 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d9924f6d-ec0b-4b13-b5bd-d9799a582554 tempest-GroupsV314Test-1666145562 None] Create group from source-group-46293936-34a9-4ee9-b904-d9dc7500aa7e completed successfully.
Jun 24 04:24:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Acquiring lock "cinder-quobyte-d570203b-bdba-4408-b07c-59117fc0f91f" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Lock "cinder-quobyte-d570203b-bdba-4408-b07c-59117fc0f91f" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e0fa14-bddd-4b01-9b71-f534cbfa7c2a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:37 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad 1073741824" returned: 0 in 1.713s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:37 devstack sudo[106592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f
Jun 24 04:24:37 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:37 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad
Jun 24 04:24:37 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:38 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f" returned: 0 in 1.108s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:38 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad" returned: 0 in 0.954s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] <== create_volume: return (2778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.782s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:38 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f
Jun 24 04:24:38 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b4606a-6c8c-4811-9b18-c9f2deb68f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b5a6dec-975a-407c-b8cb-a05785852cad', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335487e0-8cd0-4ff7-927b-2bbb5b8a6bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:38 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Volume volume-8b5a6dec-975a-407c-b8cb-a05785852cad (8b5a6dec-975a-407c-b8cb-a05785852cad): created successfully
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335487e0-8cd0-4ff7-927b-2bbb5b8a6bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:38 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Flow 'volume_create_manager' (03231d53-a264-4797-a285-df1ae772d43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-aa9782e7-0fc6-4898-8b92-5000138e37bc tempest-TestMinimumBasicScenario-1664494545 None] Created volume successfully.
Jun 24 04:24:39 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-d570203b-bdba-4408-b07c-59117fc0f91f" returned: 0 in 0.698s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Lock "cinder-quobyte-d570203b-bdba-4408-b07c-59117fc0f91f" released by "delete_volume" :: held 1.871s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Created reservations ['58ec6e9a-d6ec-448e-9c0b-00b308bf22e4'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:39 devstack cinder-volume[93470]: WARNING cinder.quota [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1943710423 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1943710423, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:39 devstack cinder-volume[93470]: WARNING cinder.quota [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1943710423 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1943710423, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Created reservations ['590df321-56be-4c50-bc86-fe64fb6947ce', '000e334c-5827-47d0-898e-f5c72304db58', 'efb940df-8722-4621-997c-a0e0759680d7', '20a73d2d-88ec-40c4-a7d3-5cedbf2bc602'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:39 devstack sudo[106606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:39 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Acquiring lock "cinder-quobyte-73c28f93-db57-48f4-9630-6ca31fc86a0f" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Lock "cinder-quobyte-73c28f93-db57-48f4-9630-6ca31fc86a0f" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:40 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.863s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:40 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b26694c5-ec0d-4bfd-9efe-a7ff4a5940b6 tempest-GroupsV314Test-1666145562 None] Delete group completed successfully.
Jun 24 04:24:40 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb813eb4-aa50-43d0-bfdd-a06fec06d637]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:40 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f
Jun 24 04:24:40 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:41 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f" returned: 0 in 1.081s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:41 devstack sudo[106617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f
Jun 24 04:24:41 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:42 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-73c28f93-db57-48f4-9630-6ca31fc86a0f" returned: 0 in 0.951s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Lock "cinder-quobyte-73c28f93-db57-48f4-9630-6ca31fc86a0f" released by "delete_volume" :: held 2.145s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Created reservations ['68a7f32c-9608-4e93-a90f-6ded9c889755'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Created reservations ['a0d55034-0135-40af-be4c-22454b193da6', 'ed2f671f-e67d-40c6-a9bb-7d2bdb20ebb0', '63fdc206-3db3-424a-9c56-55912aaa677c', '7d42add9-cd6b-4aa3-93f3-f40338c23492'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:43 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:43 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:43 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=98,cinder:INSERT=31,cinder:UPDATE=117,cinder:DELETE=8 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:24:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-3bddf1ef-c14d-4c61-ba89-6f7c1f9f727b req-6c517b1c-7753-4a87-a7a7-0b80c6ca10f0 tempest-TestMinimumBasicScenario-1664494545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-3bddf1ef-c14d-4c61-ba89-6f7c1f9f727b req-6c517b1c-7753-4a87-a7a7-0b80c6ca10f0 tempest-TestMinimumBasicScenario-1664494545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:43 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[440bc55b-e0a6-45c1-81c4-aa46d12d655f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-3bddf1ef-c14d-4c61-ba89-6f7c1f9f727b req-6c517b1c-7753-4a87-a7a7-0b80c6ca10f0 tempest-TestMinimumBasicScenario-1664494545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:43 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad
Jun 24 04:24:43 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:44 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.101s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:44 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:44 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a2b23f45-5230-4eb4-b27f-3adf03baaff0 tempest-GroupsV314Test-1666145562 None] Delete group completed successfully.
Jun 24 04:24:45 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-3bddf1ef-c14d-4c61-ba89-6f7c1f9f727b req-6c517b1c-7753-4a87-a7a7-0b80c6ca10f0 tempest-TestMinimumBasicScenario-1664494545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad" returned: 0 in 1.309s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-3bddf1ef-c14d-4c61-ba89-6f7c1f9f727b req-6c517b1c-7753-4a87-a7a7-0b80c6ca10f0 tempest-TestMinimumBasicScenario-1664494545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.370s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-3bddf1ef-c14d-4c61-ba89-6f7c1f9f727b req-6c517b1c-7753-4a87-a7a7-0b80c6ca10f0 tempest-TestMinimumBasicScenario-1664494545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-8b5a6dec-975a-407c-b8cb-a05785852cad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10e2831a-5f50-4706-9ca9-a53878ee0466', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:24:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-3bddf1ef-c14d-4c61-ba89-6f7c1f9f727b req-6c517b1c-7753-4a87-a7a7-0b80c6ca10f0 tempest-TestMinimumBasicScenario-1664494545 None] attachment_update completed successfully.
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:45 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:24:45 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:46 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.899s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c794b5-066a-4eef-9e91-6acda9426ae9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:46 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:24:46 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:47 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 1.126s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:47 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bf9a4a-5988-4f99-ba96-05b29bad2356]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:47 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:24:47 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:48 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 0.892s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.5eb0f2b3-e19d-40cd-8b9c-3c3f7790f668wd7uks7s.img {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:48 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.5eb0f2b3-e19d-40cd-8b9c-3c3f7790f668wd7uks7s.img
Jun 24 04:24:48 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:55 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=79,cinder:UPDATE=101,cinder:DELETE=7,cinder:INSERT=20 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:24:55 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.5eb0f2b3-e19d-40cd-8b9c-3c3f7790f668wd7uks7s.img" returned: 0 in 6.815s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:55 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[023ba3aa-48d2-44f0-bcaf-6e2338c7814b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:55 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:24:55 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:56 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 1.101s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:56 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.5eb0f2b3-e19d-40cd-8b9c-3c3f7790f668wd7uks7s.img {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:24:56 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Converted 1024.00 MB image at 150.24 MB/s
Jun 24 04:24:56 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:24:56 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] 5eb0f2b3-e19d-40cd-8b9c-3c3f7790f668 was raw, no need to convert to raw {{(pid=93470) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Flow 'volume_create_manager' (895d43ea-fec6-41fa-9313-c17996e3a52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94de8b4c-1fc2-4a93-890b-85f9b01a72fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94de8b4c-1fc2-4a93-890b-85f9b01a72fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-638456148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c2d3fb-5b4e-4762-8105-87fd8eecc858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce521371318048c9b54f549cf09a915d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:05Z,use_quota=True,user_id='606fff47bdd94619bc79cb8d8acd2bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e3f8eb-ad40-41f4-b0ec-a2984916aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e3f8eb-ad40-41f4-b0ec-a2984916aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079f55b8-3264-4214-a271-79d6b78cd97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079f55b8-3264-4214-a271-79d6b78cd97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c2d3fb-5b4e-4762-8105-87fd8eecc858', 'volume_name': 'volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432b3ba6-8b00-4e2d-8800-ed93e765f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432b3ba6-8b00-4e2d-8800-ed93e765f886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b466e741-37b9-43cc-8a45-66b8e1b35f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:04 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Volume f9c2d3fb-5b4e-4762-8105-87fd8eecc858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858', 'volume_size': 1}
Jun 24 04:25:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:14 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:25:14 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=2 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:25:16 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Flow 'volume_create_manager' (00964dcb-cddc-4c82-923c-4b580c4610be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06b3d9c-0aad-4c60-bee3-9ffdd3ad3d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06b3d9c-0aad-4c60-bee3-9ffdd3ad3d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1291735747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6f786c-d693-42c6-8367-fb2a8fb7388d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd4e42ee50d4a80bcca337281a6a29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:17Z,use_quota=True,user_id='f3252d4f403344ee9c9c81addb52f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69f0b13-6a82-4a2d-8075-4a65feb58350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69f0b13-6a82-4a2d-8075-4a65feb58350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d692fb5-6a00-4e68-bbf8-fb2aaf3810a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d692fb5-6a00-4e68-bbf8-fb2aaf3810a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6f786c-d693-42c6-8367-fb2a8fb7388d', 'volume_name': 'volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f20c51d-e11b-4293-85b6-e5e38bad14dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f20c51d-e11b-4293-85b6-e5e38bad14dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8590636b-a472-455e-b7c8-d352ce76ec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Volume 9f6f786c-d693-42c6-8367-fb2a8fb7388d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d', 'volume_size': 1}
Jun 24 04:25:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.268s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Uploaded volume to glance image-id: 5eb0f2b3-e19d-40cd-8b9c-3c3f7790f668. {{(pid=93470) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.727s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-638456148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c2d3fb-5b4e-4762-8105-87fd8eecc858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce521371318048c9b54f549cf09a915d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:05Z,use_quota=True,user_id='606fff47bdd94619bc79cb8d8acd2bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Creating volume f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:21 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:25:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:21 devstack sudo[107690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 1073741824
Jun 24 04:25:21 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-67ed0258-a2c9-4857-9499-68ad53039f37 tempest-VolumesActionsTest-1911343014 None] Copy volume to image completed successfully.
Jun 24 04:25:22 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 1073741824" returned: 0 in 0.865s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:22 devstack sudo[107697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858
Jun 24 04:25:22 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:23 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" returned: 0 in 0.655s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.171s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1291735747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6f786c-d693-42c6-8367-fb2a8fb7388d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd4e42ee50d4a80bcca337281a6a29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:17Z,use_quota=True,user_id='f3252d4f403344ee9c9c81addb52f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Creating volume 9f6f786c-d693-42c6-8367-fb2a8fb7388d {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:23 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b466e741-37b9-43cc-8a45-66b8e1b35f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:23 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d 1073741824
Jun 24 04:25:23 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4763ef03-5986-460a-90ab-b160bd02b872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:23 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Volume volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 (f9c2d3fb-5b4e-4762-8105-87fd8eecc858): created successfully
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4763ef03-5986-460a-90ab-b160bd02b872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Flow 'volume_create_manager' (895d43ea-fec6-41fa-9313-c17996e3a52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f323b157-211d-4f1d-b04d-f636f8c56036 tempest-SnapshotDependencyTests-527906664 None] Created volume successfully.
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:24 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d 1073741824" returned: 0 in 0.911s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:24 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d
Jun 24 04:25:24 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:24 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d" returned: 0 in 0.673s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.511s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8590636b-a472-455e-b7c8-d352ce76ec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a2ffe1-4f26-422b-ac3c-42b50fd8a63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[85944fb1-992d-4b98-8fc3-b65da44c026c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:24 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Volume volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d (9f6f786c-d693-42c6-8367-fb2a8fb7388d): created successfully
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a2ffe1-4f26-422b-ac3c-42b50fd8a63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Flow 'volume_create_manager' (00964dcb-cddc-4c82-923c-4b580c4610be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:24 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-80d15c2b-6d01-4a98-bdfe-3d5f52c4b002 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Created volume successfully.
Jun 24 04:25:25 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:25:25 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:25 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 0.869s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a554b369-69a4-480f-8a54-e4984c8bf237]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Acquiring lock "cinder-9f6f786c-d693-42c6-8367-fb2a8fb7388d-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "cinder-9f6f786c-d693-42c6-8367-fb2a8fb7388d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:25 devstack sudo[107714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:25:25 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Acquiring lock "cinder-quobyte-9f6f786c-d693-42c6-8367-fb2a8fb7388d" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "cinder-quobyte-9f6f786c-d693-42c6-8367-fb2a8fb7388d" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2ef4c9-1f03-43b7-a0fd-4526823cf1e7]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:26 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d
Jun 24 04:25:26 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:26 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 0.826s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:26 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img
Jun 24 04:25:26 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:26 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d" returned: 0 in 0.805s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:26 devstack sudo[107728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d
Jun 24 04:25:26 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:27 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f6f786c-d693-42c6-8367-fb2a8fb7388d" returned: 0 in 1.051s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "cinder-quobyte-9f6f786c-d693-42c6-8367-fb2a8fb7388d" released by "delete_volume" :: held 1.952s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:28 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Created reservations ['b2711771-e629-47ec-91ea-314844d0c0b9', '8e879d50-0236-4707-a723-45ff4c1aed6b', 'ac32eed0-afce-4a34-98e6-042cefd271a6', 'dabebd7e-f355-4aef-bd7a-022327d2a0a2'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:28 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:25:28 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:30 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 2.023s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:30 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Deleted volume successfully.
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Flow 'volume_create_manager' (f191ffbe-ffb7-4c0c-a6df-2bb76e532e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f34a25-dd45-419e-9d7c-38bfca5c2b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f02e8cec-344d-44ce-8e55-25aff0879649 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "cinder-9f6f786c-d693-42c6-8367-fb2a8fb7388d-delete_volume" released by "delete_volume" :: held 4.598s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f34a25-dd45-419e-9d7c-38bfca5c2b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-742766856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722fefdd-6863-4b22-8d30-54a295c92f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd4e42ee50d4a80bcca337281a6a29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:30Z,use_quota=True,user_id='f3252d4f403344ee9c9c81addb52f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe45599-f641-4a18-a29f-abdd6969644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe45599-f641-4a18-a29f-abdd6969644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857d6863-1940-4946-9a69-19ffcfed92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857d6863-1940-4946-9a69-19ffcfed92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722fefdd-6863-4b22-8d30-54a295c92f3d', 'volume_name': 'volume-722fefdd-6863-4b22-8d30-54a295c92f3d', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca3b7f3-5f97-439e-8c34-14f2f46be24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca3b7f3-5f97-439e-8c34-14f2f46be24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca43fc28-fab5-4d37-bc1e-ac84f732cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:30 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Volume 722fefdd-6863-4b22-8d30-54a295c92f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722fefdd-6863-4b22-8d30-54a295c92f3d', 'volume_size': 1}
Jun 24 04:25:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:32 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img" returned: 0 in 5.893s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c67e52-49db-4f63-8c37-a92730aace6c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:32 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:25:32 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:33 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 0.899s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:33 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:25:33 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Converted 1024.00 MB image at 173.74 MB/s
Jun 24 04:25:33 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] ccf01748-e18b-487e-8d1c-27fe4305822c was raw, converting to qcow2 {{(pid=93470) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 24 04:25:33 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8974a5d-98e8-49a0-810f-81737198927d]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:33 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img
Jun 24 04:25:33 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:34 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img" returned: 0 in 0.715s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:34 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img
Jun 24 04:25:34 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:34 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img" returned: 1 in 0.689s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:25:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img /opt/stack/data/cinder/conversion/vol_upload_yc3hl5um {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:34 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img /opt/stack/data/cinder/conversion/vol_upload_yc3hl5um
Jun 24 04:25:34 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:35 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img /opt/stack/data/cinder/conversion/vol_upload_yc3hl5um" returned: 0 in 0.654s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:35 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Image conversion details: src /opt/stack/data/cinder/conversion/8f136b6f-e53f-4649-aeda-3ad12b79be6b.temp_image.ccf01748-e18b-487e-8d1c-27fe4305822cen0b4jwo.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_yc3hl5um {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:25:35 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 24 04:25:35 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[26829fb5-61b2-4312-8c92-0a5ae5c7b7bf]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yc3hl5um {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:35 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yc3hl5um
Jun 24 04:25:35 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:36 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yc3hl5um" returned: 0 in 0.718s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.548s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Uploaded volume to glance image-id: ccf01748-e18b-487e-8d1c-27fe4305822c. {{(pid=93470) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 24 04:25:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.677s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Creating offline snapshot 89370f03-b348-4975-ae2e-943ae0075ff8 of volume f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:25:37 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8f32894c-39ea-427d-b491-e9be0e377193 tempest-VolumesActionsTest-1911343014 None] Copy volume to image completed successfully.
Jun 24 04:25:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e843f7-681f-4b84-9f7c-44d650d89379]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:37 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858
Jun 24 04:25:37 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:38 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" returned: 0 in 0.790s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:38 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 1G
Jun 24 04:25:38 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Acquiring lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Acquiring lock "cinder-quobyte-8f136b6f-e53f-4649-aeda-3ad12b79be6b" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-quobyte-8f136b6f-e53f-4649-aeda-3ad12b79be6b" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c17a3-1148-4e9c-86c9-786d10c49326]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:39 devstack sudo[107789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:25:39 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:39 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 1G" returned: 0 in 0.940s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:39 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8
Jun 24 04:25:39 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:39 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 0.804s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:39 devstack sudo[107799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b
Jun 24 04:25:39 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:39 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8" returned: 0 in 0.703s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:39 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 is being set with open permissions: ugo+rw
Jun 24 04:25:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:39 devstack sudo[107802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8
Jun 24 04:25:39 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:40 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8f136b6f-e53f-4649-aeda-3ad12b79be6b" returned: 0 in 0.647s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-quobyte-8f136b6f-e53f-4649-aeda-3ad12b79be6b" released by "delete_volume" :: held 1.488s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Created reservations ['3f5cd2df-95bb-49af-a94e-7f89ebae6903', '823694cc-2da4-442a-a10c-f7c7dde3b3b9', 'de1b606a-6881-4474-ae6b-a029bf3941f1', '35636656-0d9f-4cea-a8cd-f003a7f9196c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:40 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:25:40 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:40 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8" returned: 0 in 0.677s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:40 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.info
Jun 24 04:25:40 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:41 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.683s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:41 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:41 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Deleted volume successfully.
Jun 24 04:25:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-329b6523-4303-47a3-b106-0b51ecbf7555 tempest-VolumesActionsTest-1911343014 None] Lock "cinder-8f136b6f-e53f-4649-aeda-3ad12b79be6b-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:41 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.info" returned: 0 in 0.739s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:41 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.info is being set with open permissions: ugo+rw
Jun 24 04:25:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:41 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.info
Jun 24 04:25:41 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:42 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.info" returned: 0 in 0.883s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.844s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.712s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-742766856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722fefdd-6863-4b22-8d30-54a295c92f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd4e42ee50d4a80bcca337281a6a29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:30Z,use_quota=True,user_id='f3252d4f403344ee9c9c81addb52f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Creating volume 722fefdd-6863-4b22-8d30-54a295c92f3d {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:42 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:25:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:42 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d 1073741824
Jun 24 04:25:42 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d6e9d3a1-e3c8-4983-b70c-ebc543889c20 tempest-SnapshotDependencyTests-527906664 None] Create snapshot completed successfully
Jun 24 04:25:43 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d 1073741824" returned: 0 in 1.183s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:43 devstack sudo[107830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d
Jun 24 04:25:43 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Flow 'volume_create_manager' (5cf9d25c-4200-409d-ac7e-20c83acc53fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6174c562-8ad2-4d16-9218-0254577d4cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6174c562-8ad2-4d16-9218-0254577d4cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4367f3-b4f8-49cb-b257-8eb726b242f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce521371318048c9b54f549cf09a915d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=89370f03-b348-4975-ae2e-943ae0075ff8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:44Z,use_quota=True,user_id='606fff47bdd94619bc79cb8d8acd2bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789fa32e-c2d5-4358-bddf-498a362f561c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789fa32e-c2d5-4358-bddf-498a362f561c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6896fcff-7a3f-427b-879a-58ac1ff8d314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6896fcff-7a3f-427b-879a-58ac1ff8d314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa4367f3-b4f8-49cb-b257-8eb726b242f9', 'volume_name': 'volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9', 'volume_size': 1, 'snapshot_id': '89370f03-b348-4975-ae2e-943ae0075ff8'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fa6519-796a-4361-931a-59c19445fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fa6519-796a-4361-931a-59c19445fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb04098-9dde-4c57-9a19-b0f24594c0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:44 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Volume aa4367f3-b4f8-49cb-b257-8eb726b242f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9', 'volume_size': 1, 'snapshot_id': '89370f03-b348-4975-ae2e-943ae0075ff8'}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:44 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d" returned: 0 in 0.767s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.262s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-quobyte-89370f03-b348-4975-ae2e-943ae0075ff8-aa4367f3-b4f8-49cb-b257-8eb726b242f9" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca43fc28-fab5-4d37-bc1e-ac84f732cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722fefdd-6863-4b22-8d30-54a295c92f3d', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e7089-c2a3-4665-9c03-523f6d2ac1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-89370f03-b348-4975-ae2e-943ae0075ff8-aa4367f3-b4f8-49cb-b257-8eb726b242f9" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Creating volume aa4367f3-b4f8-49cb-b257-8eb726b242f9 from snapshot 89370f03-b348-4975-ae2e-943ae0075ff8 {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-quobyte-aa4367f3-b4f8-49cb-b257-8eb726b242f9" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:44 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Volume volume-722fefdd-6863-4b22-8d30-54a295c92f3d (722fefdd-6863-4b22-8d30-54a295c92f3d): created successfully
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e7089-c2a3-4665-9c03-523f6d2ac1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Flow 'volume_create_manager' (f191ffbe-ffb7-4c0c-a6df-2bb76e532e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-aa4367f3-b4f8-49cb-b257-8eb726b242f9" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] snapshot: 89370f03-b348-4975-ae2e-943ae0075ff8, volume: aa4367f3-b4f8-49cb-b257-8eb726b242f9,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:25:44 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-045bea74-0f6a-4900-ba9e-f00ba222ca33 tempest-VolumeQuotasAdminTestJSON-1681368934 None] Created volume successfully.
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7c0442-06c8-4cec-8af8-41faa5c87061]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:44 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8
Jun 24 04:25:44 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-6a0530da-d45b-47ef-9098-7528d650aa67 req-494cc232-4c7c-4491-bbf7-a09345fe64f6 tempest-TestMinimumBasicScenario-1664494545 None] Terminate volume connection completed successfully.
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-6a0530da-d45b-47ef-9098-7528d650aa67 req-494cc232-4c7c-4491-bbf7-a09345fe64f6 tempest-TestMinimumBasicScenario-1664494545 None] Deleting attachment 10e2831a-5f50-4706-9ca9-a53878ee0466. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:45 devstack sudo[107841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:25:45 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:45 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8" returned: 0 in 1.098s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e82b9-a84f-4c6b-8a1a-b3cdf8017ff7]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:45 devstack sudo[107847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858
Jun 24 04:25:45 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c691436a-48ef-4036-8b6e-3084355d9c17 tempest-VolumeQuotasAdminTestJSON-457236994 None] Transfer volume completed successfully.
Jun 24 04:25:46 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.903s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:25:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:25:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:25:46 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" returned: 0 in 1.122s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:46 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9 not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:25:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:46 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9
Jun 24 04:25:46 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Acquiring lock "cinder-722fefdd-6863-4b22-8d30-54a295c92f3d-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Lock "cinder-722fefdd-6863-4b22-8d30-54a295c92f3d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Acquiring lock "cinder-quobyte-722fefdd-6863-4b22-8d30-54a295c92f3d" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Lock "cinder-quobyte-722fefdd-6863-4b22-8d30-54a295c92f3d" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f6ee22-de6f-44ac-a16c-a39d55e01032]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Acquiring lock "cinder-8b5a6dec-975a-407c-b8cb-a05785852cad-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Lock "cinder-8b5a6dec-975a-407c-b8cb-a05785852cad-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Acquiring lock "cinder-quobyte-8b5a6dec-975a-407c-b8cb-a05785852cad" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:47 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d
Jun 24 04:25:47 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Lock "cinder-quobyte-8b5a6dec-975a-407c-b8cb-a05785852cad" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cace4616-928c-4c9e-b827-dc3aca413a28]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:47 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad
Jun 24 04:25:47 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:48 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d" returned: 0 in 1.548s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:48 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d
Jun 24 04:25:48 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:49 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad" returned: 0 in 1.819s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:49 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad
Jun 24 04:25:49 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:50 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-722fefdd-6863-4b22-8d30-54a295c92f3d" returned: 0 in 1.933s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Lock "cinder-quobyte-722fefdd-6863-4b22-8d30-54a295c92f3d" released by "delete_volume" :: held 3.551s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Created reservations ['0710bc76-d447-4559-80f9-843f0763e0e0', 'd363a915-0e06-4fcc-94ec-4f88f61a1d05', 'a04b474b-9b8f-4531-bcff-a9db1109711c', 'c3bdbc52-ee04-4064-b4f7-8f5b8a8a1a75'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:51 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:25:51 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:51 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8b5a6dec-975a-407c-b8cb-a05785852cad" returned: 0 in 2.191s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Flow 'volume_create_manager' (9fa34470-59ac-47d1-bdd2-3b8603991afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c535b29f-0f2a-40d6-9dfd-9e184b817757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Lock "cinder-quobyte-8b5a6dec-975a-407c-b8cb-a05785852cad" released by "delete_volume" :: held 4.143s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c535b29f-0f2a-40d6-9dfd-9e184b817757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-881903906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b826d44-5566-4079-9a8f-daa447b59d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6270c6197448408d83c5ede07a2fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:51Z,use_quota=True,user_id='bbdad3a9b5cd4c24acc7bc899cd4d858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ea79bc-8c55-4c4d-ad69-e34d218fedc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ea79bc-8c55-4c4d-ad69-e34d218fedc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb95dbf-2c03-4819-b6c9-20336af694fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:25:51 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Created reservations ['adafee0b-fd2b-4678-80f3-d249e42de151', '220a49dc-2f38-4fe0-b810-7f9b25066b0e', 'e9919187-f8a6-4081-9e65-741639f45d42', '71ab38fa-ae33-4228-9045-ce89ab35dcaf'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:52 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:25:52 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb95dbf-2c03-4819-b6c9-20336af694fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b826d44-5566-4079-9a8f-daa447b59d5a', 'volume_name': 'volume-5b826d44-5566-4079-9a8f-daa447b59d5a', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76acd700>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440962fb-14b3-4fea-8d7c-729283f1c6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440962fb-14b3-4fea-8d7c-729283f1c6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:52 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032a947b-4cc2-408d-8db1-93dd3b9e190e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:52 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Volume 5b826d44-5566-4079-9a8f-daa447b59d5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b826d44-5566-4079-9a8f-daa447b59d5a', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76acd700>}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Trying to clone 5b826d44-5566-4079-9a8f-daa447b59d5a from image 1fe711f9-301b-47ca-8464-f7cda30438a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.434s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Deleted volume successfully.
Jun 24 04:25:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-64071e54-e114-4fe2-b3b2-e050a6142a59 tempest-VolumeQuotasAdminTestJSON-1486953092 None] Lock "cinder-722fefdd-6863-4b22-8d30-54a295c92f3d-delete_volume" released by "delete_volume" :: held 5.634s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:53 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.497s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Deleted volume successfully.
Jun 24 04:25:53 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD, size 20.69 MB, duration 1.01 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:25:53 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Image download 20.69 MB at 20.48 MB/s
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7327866c-47a4-4766-8c2b-5de0d236a232 tempest-TestMinimumBasicScenario-1664494545 None] Lock "cinder-8b5a6dec-975a-407c-b8cb-a05785852cad-delete_volume" released by "delete_volume" :: held 6.265s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9" returned: 0 in 7.012s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[add7b822-1689-4ec9-a564-476ecf5b4041]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa9ddee-394a-4d9f-8ba6-e7e402197753]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:53 devstack sudo[107892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858
Jun 24 04:25:53 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:53 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD
Jun 24 04:25:53 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:54 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD" returned: 0 in 1.090s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:54 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Temporary image 1fe711f9-301b-47ca-8464-f7cda30438a4 is fetched for user bbdad3a9b5cd4c24acc7bc899cd4d858. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:25:54 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdf87f5-8e47-43db-bd9f-26e545c21976]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:55 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD
Jun 24 04:25:55 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:55 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" returned: 0 in 1.481s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:25:55 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Converted 1024.00 MB image at 146.00 MB/s
Jun 24 04:25:55 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9 is being set with open permissions: ugo+rw
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:55 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9
Jun 24 04:25:55 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:55 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:55 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9" returned: 0 in 0.778s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-aa4367f3-b4f8-49cb-b257-8eb726b242f9" released by "_copy_volume_from_snapshot" :: held 11.615s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-89370f03-b348-4975-ae2e-943ae0075ff8-aa4367f3-b4f8-49cb-b257-8eb726b242f9" released by "_create_volume_from_snapshot" :: held 11.662s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.703s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.233s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-881903906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b826d44-5566-4079-9a8f-daa447b59d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6270c6197448408d83c5ede07a2fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:51Z,use_quota=True,user_id='bbdad3a9b5cd4c24acc7bc899cd4d858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Creating volume 5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:56 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:56 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a 1073741824
Jun 24 04:25:56 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb04098-9dde-4c57-9a19-b0f24594c0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9', 'volume_size': 1, 'snapshot_id': '89370f03-b348-4975-ae2e-943ae0075ff8'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942b0809-95b8-43ea-b61b-8fe0686affc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:56 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Volume volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9 (aa4367f3-b4f8-49cb-b257-8eb726b242f9): created successfully
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942b0809-95b8-43ea-b61b-8fe0686affc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Flow 'volume_create_manager' (5cf9d25c-4200-409d-ac7e-20c83acc53fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4a5f5ab9-bc58-4daf-83ab-8b1d1d43bb87 tempest-SnapshotDependencyTests-527906664 None] Created volume successfully.
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-89370f03-b348-4975-ae2e-943ae0075ff8-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-89370f03-b348-4975-ae2e-943ae0075ff8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-quobyte-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-quobyte-89370f03-b348-4975-ae2e-943ae0075ff8" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-89370f03-b348-4975-ae2e-943ae0075ff8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Deleting offline snapshot 89370f03-b348-4975-ae2e-943ae0075ff8 of volume f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] snapshot_file for this snap is: volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[04452a03-008f-4b4e-85f4-a0d0acf2ba0f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:56 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8
Jun 24 04:25:56 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:57 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a 1073741824" returned: 0 in 1.105s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:57 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:25:57 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:57 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8" returned: 0 in 0.956s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:57 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a825859-baf6-4f1a-af7a-9b411ac4cb98]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:57 devstack sudo[107973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858
Jun 24 04:25:57 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:58 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 0 in 0.867s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:58 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Attempting download of 1fe711f9-301b-47ca-8464-f7cda30438a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}])) to volume 5b826d44-5566-4079-9a8f-daa447b59d5a. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:25:58 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[393eb6d3-a21b-422f-b4a3-f68995e0dd90]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_7ukm1666 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:58 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_7ukm1666
Jun 24 04:25:58 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:58 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" returned: 0 in 0.916s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:58 devstack sudo[107981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8
Jun 24 04:25:58 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:59 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_7ukm1666" returned: 0 in 0.867s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_7ukm1666 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:59 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_7ukm1666
Jun 24 04:25:59 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:59 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8" returned: 0 in 0.911s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:59 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8
Jun 24 04:25:59 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:59 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_7ukm1666" returned: 1 in 0.764s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_7ukm1666' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:25:59 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbce4d1-9a5a-47a9-870b-fd370ec57714]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:59 devstack sudo[107996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD
Jun 24 04:25:59 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:00 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858.89370f03-b348-4975-ae2e-943ae0075ff8" returned: 0 in 0.817s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-89370f03-b348-4975-ae2e-943ae0075ff8" released by "_delete_snapshot" :: held 3.757s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" released by "delete_snapshot" :: held 3.794s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Created reservations ['d1d32fd2-c0e3-4999-9c40-ef3d668d86aa', 'f317b5c9-aec3-47bf-a6ed-9ef152bd269a', '761a4a52-81de-4f2e-b390-1a333b9ea58a', 'e7a17a61-4a69-43a1-a885-07714b537bff'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Delete snapshot completed successfully.
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0ccc25ad-b016-40c5-8118-58f39e01d458 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-89370f03-b348-4975-ae2e-943ae0075ff8-delete_snapshot" released by "delete_snapshot" :: held 3.970s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-f9c2d3fb-5b4e-4762-8105-87fd8eecc858-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:00 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD" returned: 0 in 1.012s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] 1fe711f9-301b-47ca-8464-f7cda30438a4 was qcow2, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-f9c2d3fb-5b4e-4762-8105-87fd8eecc858-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:00 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:26:00 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-quobyte-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e230a8-693d-44a1-84f2-d0a32fdd094e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:01 devstack sudo[108004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858
Jun 24 04:26:01 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:01 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" returned: 0 in 1.006s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:02 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858
Jun 24 04:26:02 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Flow 'volume_create_manager' (5a6ef175-027e-4664-93cb-8aafccbbd46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf34ef7-66a1-469d-a2fb-f5ef161b4e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf34ef7-66a1-469d-a2fb-f5ef161b4e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-883704733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d2c33345d5405689ac63eb68ab3f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:02Z,use_quota=True,user_id='f501a6bff15e4c9a8ea338d992d550c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0b181d2-0dc1-49ba-b61f-45d09a756c3f),volume_type_id=e0b181d2-0dc1-49ba-b61f-45d09a756c3f)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3182412b-2c9e-4031-be8a-86876fa82fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3182412b-2c9e-4031-be8a-86876fa82fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b521a5-2f5c-42ce-8ff6-67939ccdb3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b521a5-2f5c-42ce-8ff6-67939ccdb3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c', 'volume_name': 'volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38464917-1358-48f4-a24e-704b27aba4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38464917-1358-48f4-a24e-704b27aba4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d930b171-2b8f-44d1-a876-8315533e833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:02 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Volume b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c', 'volume_size': 1}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-883704733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d2c33345d5405689ac63eb68ab3f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:02Z,use_quota=True,user_id='f501a6bff15e4c9a8ea338d992d550c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0b181d2-0dc1-49ba-b61f-45d09a756c3f),volume_type_id=e0b181d2-0dc1-49ba-b61f-45d09a756c3f)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Creating volume b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:02 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:02 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c 1073741824
Jun 24 04:26:02 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:02 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" returned: 0 in 0.963s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-f9c2d3fb-5b4e-4762-8105-87fd8eecc858" released by "delete_volume" :: held 2.078s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Created reservations ['21a252bc-0585-4a8e-8932-57cd1c600eae', 'c7a0bd0a-f3f1-4cb7-bb1c-4266937f0f27', '516ef988-b45b-49b4-8328-fbe67e8bceca', 'b427e804-5569-4210-926a-f7bb879f1886'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:03 devstack sudo[108028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:03 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:03 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 0 in 2.508s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_d9998s8wdevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:26:03 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Converted 112.00 MB image at 44.64 MB/s
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:03 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a 1G
Jun 24 04:26:03 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:03 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c 1073741824" returned: 0 in 1.156s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:03 devstack sudo[108032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c
Jun 24 04:26:03 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:04 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.894s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Deleted volume successfully.
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ef4bdc23-3202-43ab-8b85-3afba5ee19a4 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-f9c2d3fb-5b4e-4762-8105-87fd8eecc858-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-aa4367f3-b4f8-49cb-b257-8eb726b242f9-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-aa4367f3-b4f8-49cb-b257-8eb726b242f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "cinder-quobyte-aa4367f3-b4f8-49cb-b257-8eb726b242f9" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-aa4367f3-b4f8-49cb-b257-8eb726b242f9" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8285267-43ae-4671-8756-d9d372c71ae1]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:04 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a 1G" returned: 0 in 1.175s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:04 devstack sudo[108039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9
Jun 24 04:26:04 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:04 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a8a3f-850f-4fab-a64e-bdf926c73a19]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c" returned: 0 in 1.005s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d930b171-2b8f-44d1-a876-8315533e833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b4ae81-a736-4b86-ae02-3a0d4e177742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:04 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Volume volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c (b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c): created successfully
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b4ae81-a736-4b86-ae02-3a0d4e177742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Flow 'volume_create_manager' (5a6ef175-027e-4664-93cb-8aafccbbd46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c10f0c28-0e49-418e-928c-9601f9d6235a tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Created volume successfully.
Jun 24 04:26:04 devstack sudo[108041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:26:04 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:05 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9" returned: 0 in 0.927s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:05 devstack sudo[108051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9
Jun 24 04:26:05 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:05 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 0 in 0.934s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:05 devstack sudo[108053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:26:05 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:05 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:05 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:06 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aa4367f3-b4f8-49cb-b257-8eb726b242f9" returned: 0 in 0.744s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-quobyte-aa4367f3-b4f8-49cb-b257-8eb726b242f9" released by "delete_volume" :: held 1.721s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Created reservations ['7a1e58a2-d75a-403c-8177-d699531a3acf', '7abb7077-df7d-44e2-8353-f4c92281270b', '22454021-fe50-46ce-b12a-d34e96071df3', 'bbede111-d4e9-42ae-8c23-1d2d8d410ffc'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:06 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:06 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:06 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 1 in 0.998s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Downloaded image 1fe711f9-301b-47ca-8464-f7cda30438a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}])) to volume 5b826d44-5566-4079-9a8f-daa447b59d5a successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Temporary image 1fe711f9-301b-47ca-8464-f7cda30438a4 for user bbdad3a9b5cd4c24acc7bc899cd4d858 is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Marking volume 5b826d44-5566-4079-9a8f-daa447b59d5a as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Copying metadata from image 1fe711f9-301b-47ca-8464-f7cda30438a4 to 5b826d44-5566-4079-9a8f-daa447b59d5a. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Creating volume glance metadata for volume 5b826d44-5566-4079-9a8f-daa447b59d5a backed by image 1fe711f9-301b-47ca-8464-f7cda30438a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032a947b-4cc2-408d-8db1-93dd3b9e190e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b826d44-5566-4079-9a8f-daa447b59d5a', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76acd700>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb68597-3008-4c02-afd2-58a3cc45bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:06 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Volume volume-5b826d44-5566-4079-9a8f-daa447b59d5a (5b826d44-5566-4079-9a8f-daa447b59d5a): created successfully
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb68597-3008-4c02-afd2-58a3cc45bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Flow 'volume_create_manager' (9fa34470-59ac-47d1-bdd2-3b8603991afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-30281790-5cec-47d3-9305-0b729e08a945 tempest-VolumesExtendTest-1391241516 None] Created volume successfully.
Jun 24 04:26:06 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.896s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:06 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-caa0bf14-10e7-4320-90ea-22e26e21a01c tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Retype volume completed successfully.
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[713adfd3-bcc0-4eb1-9876-07c5141461af]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Acquiring lock "cinder-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:07 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:26:07 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "cinder-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:07 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.095s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:07 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Deleted volume successfully.
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Acquiring lock "cinder-quobyte-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-76bf9b59-a652-4851-a935-4d9c5b20bbc2 tempest-SnapshotDependencyTests-527906664 None] Lock "cinder-aa4367f3-b4f8-49cb-b257-8eb726b242f9-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "cinder-quobyte-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5776c883-7e39-4462-a07b-341ddd94859a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:07 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c
Jun 24 04:26:07 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:08 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 0 in 0.959s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:08 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:26:08 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:08 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c" returned: 0 in 1.059s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:08 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c
Jun 24 04:26:08 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:09 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 1 in 1.051s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a 2G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a 2G" returned: 0 in 0.093s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.214s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:09 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-56e4fd97-1721-4fd9-9d2e-5ee87574477a tempest-VolumesExtendTest-1391241516 None] Extend volume completed successfully.
Jun 24 04:26:09 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c" returned: 0 in 0.904s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "cinder-quobyte-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c" released by "delete_volume" :: held 2.021s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:09 devstack cinder-volume[93470]: WARNING cinder.quota [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:26:09 devstack cinder-volume[93470]: WARNING cinder.quota [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Created reservations ['e7113d13-3b91-4197-bf1f-f207d5e8ee17', '16d02249-c669-470b-8afa-afa2bd217bf2', 'df2cf917-4ea4-476b-b4c2-9a9f951a252b', '0211e8a9-d45c-49c1-992c-d1699ea7f049'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:09 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:09 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:10 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Acquiring lock "cinder-5b826d44-5566-4079-9a8f-daa447b59d5a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.015s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Deleted volume successfully.
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Lock "cinder-5b826d44-5566-4079-9a8f-daa447b59d5a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9dd117fd-6eee-4348-8d50-d0961a79a13b tempest-VolumeRetypeWithoutMigrationTest-94852521 None] Lock "cinder-b77fe3ed-099f-46f9-8a24-5dd6ec32ef1c-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Acquiring lock "cinder-quobyte-5b826d44-5566-4079-9a8f-daa447b59d5a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Lock "cinder-quobyte-5b826d44-5566-4079-9a8f-daa447b59d5a" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e9102-53ad-4143-a0d2-39eeb7059bdd]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:11 devstack sudo[108093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:26:11 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:11 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 0 in 1.073s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:12 devstack sudo[108099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:26:12 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:12 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 1 in 0.917s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:26:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:12 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a
Jun 24 04:26:12 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:13 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5b826d44-5566-4079-9a8f-daa447b59d5a" returned: 0 in 0.870s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Lock "cinder-quobyte-5b826d44-5566-4079-9a8f-daa447b59d5a" released by "delete_volume" :: held 2.950s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Created reservations ['5d253dee-8857-4e95-a5b9-d49ad5e68782', '32036728-db5e-4d99-8bb3-8c35415cac13', '14f1e2a4-30dd-4840-a598-cbb1d7fc136c', '6c0d9ac2-3adc-438e-be94-8875b70df111'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:14 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:14 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Flow 'volume_create_manager' (eeeecb4b-b155-4671-9f56-482dee471f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9291882f-a66d-4a22-9ade-0a23f8081f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9291882f-a66d-4a22-9ade-0a23f8081f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-577606307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a23e15-8f55-4afb-86aa-b119cb8f77e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6270c6197448408d83c5ede07a2fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:15Z,use_quota=True,user_id='bbdad3a9b5cd4c24acc7bc899cd4d858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a9e2e9-52df-448e-9ce4-9d936a6925b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a9e2e9-52df-448e-9ce4-9d936a6925b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223b5a4d-2f9d-4f60-9bb7-9c194f0596f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223b5a4d-2f9d-4f60-9bb7-9c194f0596f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a23e15-8f55-4afb-86aa-b119cb8f77e0', 'volume_name': 'volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6366365-5dc2-4d88-b7ad-fa6bccebbe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6366365-5dc2-4d88-b7ad-fa6bccebbe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b877f5ac-3181-4dd1-b495-e42692fca346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:14 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Volume 17a23e15-8f55-4afb-86aa-b119cb8f77e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0', 'volume_size': 1}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-577606307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a23e15-8f55-4afb-86aa-b119cb8f77e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6270c6197448408d83c5ede07a2fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:15Z,use_quota=True,user_id='bbdad3a9b5cd4c24acc7bc899cd4d858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Creating volume 17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:14 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:26:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:15 devstack sudo[108124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 1073741824
Jun 24 04:26:15 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:15 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.318s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:15 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:15 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Deleted volume successfully.
Jun 24 04:26:15 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=107,cinder:SELECT=78,cinder:INSERT=27,cinder:DELETE=9 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:26:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-da331207-cd6e-496e-9f9e-7c85da024f8c tempest-VolumesExtendTest-1391241516 None] Lock "cinder-5b826d44-5566-4079-9a8f-daa447b59d5a-delete_volume" released by "delete_volume" :: held 4.658s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=87,cinder:UPDATE=89,cinder:INSERT=28,cinder:DELETE=6 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Flow 'volume_create_manager' (b6b94e4d-49b9-47f3-9b71-691de9701ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c0940f-a0f3-4368-a3b3-7e19314bd8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c0940f-a0f3-4368-a3b3-7e19314bd8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f11538b-df41-4b99-bed2-5be1a6551946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7407dea6bff54186be121ff42a5434c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:16Z,use_quota=True,user_id='0786c7b4dcb049ee95cecd1145a68443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d591a389-5fe0-40d6-bc4e-c8c2576e4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d591a389-5fe0-40d6-bc4e-c8c2576e4416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0b6e12-5e35-4270-a517-fcc959afdd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0b6e12-5e35-4270-a517-fcc959afdd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f11538b-df41-4b99-bed2-5be1a6551946', 'volume_name': 'volume-6f11538b-df41-4b99-bed2-5be1a6551946', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba13069d-192c-4120-a6fe-c84a53248459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba13069d-192c-4120-a6fe-c84a53248459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863c4279-bfce-4e27-b3f6-3516200cf5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:16 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Volume 6f11538b-df41-4b99-bed2-5be1a6551946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f11538b-df41-4b99-bed2-5be1a6551946', 'volume_size': 1}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:16 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 1073741824" returned: 0 in 1.410s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:16 devstack sudo[108153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0
Jun 24 04:26:16 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:17 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0" returned: 0 in 0.808s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f11538b-df41-4b99-bed2-5be1a6551946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7407dea6bff54186be121ff42a5434c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:16Z,use_quota=True,user_id='0786c7b4dcb049ee95cecd1145a68443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Creating volume 6f11538b-df41-4b99-bed2-5be1a6551946 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:17 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b877f5ac-3181-4dd1-b495-e42692fca346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:17 devstack sudo[108157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946 1073741824
Jun 24 04:26:17 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38f62fa-8f20-4718-82d7-fc20142122b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Volume volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 (17a23e15-8f55-4afb-86aa-b119cb8f77e0): created successfully
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38f62fa-8f20-4718-82d7-fc20142122b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Flow 'volume_create_manager' (eeeecb4b-b155-4671-9f56-482dee471f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:17 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-92dec87f-4aa2-4be6-898e-468c388a4d9c tempest-VolumesExtendTest-1391241516 None] Created volume successfully.
Jun 24 04:26:18 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946 1073741824" returned: 0 in 0.979s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:18 devstack sudo[108163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946
Jun 24 04:26:18 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Flow 'volume_create_manager' (898fe73d-f727-4cc5-88af-aa9245687a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da850c1-4032-4bc9-baee-dbba2472c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da850c1-4032-4bc9-baee-dbba2472c16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-896861384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c92a78-38a7-40eb-8858-ade39bec3800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38381619af94e6c9fa2bcfd0ef38d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:19Z,use_quota=True,user_id='f9f09584ea544d59ac274dfcd525c63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59efe784-4e06-4f2c-aac5-9a8ff8674a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59efe784-4e06-4f2c-aac5-9a8ff8674a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c1f754-6806-4654-8683-9ef90671db4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:18 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c1f754-6806-4654-8683-9ef90671db4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c92a78-38a7-40eb-8858-ade39bec3800', 'volume_name': 'volume-63c92a78-38a7-40eb-8858-ade39bec3800', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344886a5-517d-4d63-b500-3bb83da15e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344886a5-517d-4d63-b500-3bb83da15e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b668de-a87f-468e-b260-f0bfa93a061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:19 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Volume 63c92a78-38a7-40eb-8858-ade39bec3800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c92a78-38a7-40eb-8858-ade39bec3800', 'volume_size': 1}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:19 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946" returned: 0 in 0.790s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.672s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Creating offline snapshot c66f6188-9897-4d86-8570-fc598c034768 of volume 17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863c4279-bfce-4e27-b3f6-3516200cf5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f11538b-df41-4b99-bed2-5be1a6551946', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3159f8-f16f-406d-b486-fc100406d013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf6713f-c017-4103-a2ca-b1d7bade3725]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:19 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Volume volume-6f11538b-df41-4b99-bed2-5be1a6551946 (6f11538b-df41-4b99-bed2-5be1a6551946): created successfully
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3159f8-f16f-406d-b486-fc100406d013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Flow 'volume_create_manager' (b6b94e4d-49b9-47f3-9b71-691de9701ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:19 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-16a2a6c9-b57b-4b51-8f77-f3db230dd202 tempest-CinderUnicodeTest-676881283 None] Created volume successfully.
Jun 24 04:26:19 devstack sudo[108166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0
Jun 24 04:26:19 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:19 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0" returned: 0 in 0.788s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:19 devstack sudo[108171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 1G
Jun 24 04:26:19 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Flow 'volume_create_manager' (59b19e8a-eaa8-4134-bf68-82709de0fb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bea6c58-0469-4666-9f57-f17ec9e6343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bea6c58-0469-4666-9f57-f17ec9e6343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1170582544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93df2b6-2a50-4fdd-b94f-4724f0e95770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7407dea6bff54186be121ff42a5434c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:20Z,use_quota=True,user_id='0786c7b4dcb049ee95cecd1145a68443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db8cce2-0398-4416-be6b-4e26f8121b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db8cce2-0398-4416-be6b-4e26f8121b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac93b46-ae9c-4945-ac9a-12129c54ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac93b46-ae9c-4945-ac9a-12129c54ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93df2b6-2a50-4fdd-b94f-4724f0e95770', 'volume_name': 'volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb561d9-83e9-4dd7-bccf-08f349f43845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb561d9-83e9-4dd7-bccf-08f349f43845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e20adc4-4f17-471f-86cb-eb903991eff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:20 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Volume a93df2b6-2a50-4fdd-b94f-4724f0e95770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770', 'volume_size': 1}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:20 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 1G" returned: 0 in 0.790s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:20 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768
Jun 24 04:26:20 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:21 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768" returned: 0 in 0.698s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:21 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 is being set with open permissions: ugo+rw
Jun 24 04:26:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:21 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768
Jun 24 04:26:21 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:22 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768" returned: 0 in 0.636s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:22 devstack sudo[108185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.info
Jun 24 04:26:22 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:22 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.info" returned: 0 in 0.630s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:22 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.info is being set with open permissions: ugo+rw
Jun 24 04:26:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:22 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.info
Jun 24 04:26:22 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:23 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.info" returned: 0 in 0.620s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.260s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.325s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-896861384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c92a78-38a7-40eb-8858-ade39bec3800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38381619af94e6c9fa2bcfd0ef38d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:19Z,use_quota=True,user_id='f9f09584ea544d59ac274dfcd525c63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Creating volume 63c92a78-38a7-40eb-8858-ade39bec3800 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:23 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:23 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800 1073741824
Jun 24 04:26:23 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:23 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fc1f4b09-0414-4ae7-b8c4-8f6019e4b377 tempest-VolumesExtendTest-1391241516 None] Create snapshot completed successfully
Jun 24 04:26:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-71c09111-71f7-44dd-83a6-1532c5f86b84 tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:24 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800 1073741824" returned: 0 in 0.819s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:24 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800
Jun 24 04:26:24 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:24 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800" returned: 0 in 0.632s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.754s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1170582544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93df2b6-2a50-4fdd-b94f-4724f0e95770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7407dea6bff54186be121ff42a5434c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:20Z,use_quota=True,user_id='0786c7b4dcb049ee95cecd1145a68443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Creating volume a93df2b6-2a50-4fdd-b94f-4724f0e95770 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:24 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:24 devstack sudo[108199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 1073741824
Jun 24 04:26:24 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b668de-a87f-468e-b260-f0bfa93a061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c92a78-38a7-40eb-8858-ade39bec3800', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e7e5bd-9f3b-44e9-bb3e-9f6038108eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:24 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Volume volume-63c92a78-38a7-40eb-8858-ade39bec3800 (63c92a78-38a7-40eb-8858-ade39bec3800): created successfully
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e7e5bd-9f3b-44e9-bb3e-9f6038108eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Flow 'volume_create_manager' (898fe73d-f727-4cc5-88af-aa9245687a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:24 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9aabacb5-be61-4776-aeed-b586f12ae459 tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Created volume successfully.
Jun 24 04:26:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:25 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 1073741824" returned: 0 in 0.854s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:25 devstack sudo[108205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770
Jun 24 04:26:25 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:26 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770" returned: 0 in 0.634s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-71c09111-71f7-44dd-83a6-1532c5f86b84 tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.668s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e20adc4-4f17-471f-86cb-eb903991eff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d2bb5a-55b0-49e7-b7d2-9ac9203f0a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c65620-8bde-4d91-878f-e51152506a68]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-71c09111-71f7-44dd-83a6-1532c5f86b84 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:26 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Volume volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 (a93df2b6-2a50-4fdd-b94f-4724f0e95770): created successfully
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d2bb5a-55b0-49e7-b7d2-9ac9203f0a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Flow 'volume_create_manager' (59b19e8a-eaa8-4134-bf68-82709de0fb31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a15356a4-38b3-4bd4-a4cf-2137627d436c tempest-CinderUnicodeTest-676881283 None] Created volume successfully.
Jun 24 04:26:26 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0
Jun 24 04:26:26 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:27 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-71c09111-71f7-44dd-83a6-1532c5f86b84 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0" returned: 0 in 0.732s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-71c09111-71f7-44dd-83a6-1532c5f86b84 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 2G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-71c09111-71f7-44dd-83a6-1532c5f86b84 tempest-VolumesExtendTest-1391241516 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 2G" returned: 0 in 0.117s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-71c09111-71f7-44dd-83a6-1532c5f86b84 tempest-VolumesExtendTest-1391241516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.891s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.783s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Creating offline snapshot ac5a9242-28b7-428d-9aba-b1ef3fab6883 of volume 63c92a78-38a7-40eb-8858-ade39bec3800 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f770275b-aa5d-4cf8-b6b8-2a5788f24a76]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-71c09111-71f7-44dd-83a6-1532c5f86b84 tempest-VolumesExtendTest-1391241516 None] Extend volume completed successfully.
Jun 24 04:26:27 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800
Jun 24 04:26:27 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:28 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800" returned: 0 in 0.787s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Acquiring lock "cinder-c66f6188-9897-4d86-8570-fc598c034768-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:28 devstack sudo[108222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 1G
Jun 24 04:26:28 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Lock "cinder-c66f6188-9897-4d86-8570-fc598c034768-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Acquiring lock "cinder-quobyte-17a23e15-8f55-4afb-86aa-b119cb8f77e0" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Lock "cinder-quobyte-17a23e15-8f55-4afb-86aa-b119cb8f77e0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Acquiring lock "cinder-quobyte-c66f6188-9897-4d86-8570-fc598c034768" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Lock "cinder-quobyte-c66f6188-9897-4d86-8570-fc598c034768" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Deleting offline snapshot c66f6188-9897-4d86-8570-fc598c034768 of volume 17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] snapshot_file for this snap is: volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8653795-ba8c-452f-a2a7-ab47b58aeaf5]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:28 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768
Jun 24 04:26:28 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:28 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 1G" returned: 0 in 0.830s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c92a78-38a7-40eb-8858-ade39bec3800 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:28 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c92a78-38a7-40eb-8858-ade39bec3800 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883
Jun 24 04:26:28 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:28 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768" returned: 0 in 0.775s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:26:29 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1bf1ee-962d-460f-b6b0-3d9f1396f4c2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:29 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0
Jun 24 04:26:29 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:29 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c92a78-38a7-40eb-8858-ade39bec3800 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883" returned: 0 in 0.708s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:29 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 is being set with open permissions: ugo+rw
Jun 24 04:26:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:29 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883
Jun 24 04:26:29 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:29 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0" returned: 0 in 0.806s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:29 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768
Jun 24 04:26:29 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:30 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883" returned: 0 in 0.666s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:30 devstack sudo[108247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.info
Jun 24 04:26:30 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:30 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768" returned: 0 in 0.800s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:30 devstack sudo[108252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768
Jun 24 04:26:30 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:31 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.info" returned: 0 in 0.682s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:31 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.info is being set with open permissions: ugo+rw
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:31 devstack sudo[108255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.info
Jun 24 04:26:31 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:31 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0.c66f6188-9897-4d86-8570-fc598c034768" returned: 0 in 0.656s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Lock "cinder-quobyte-c66f6188-9897-4d86-8570-fc598c034768" released by "_delete_snapshot" :: held 3.142s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Lock "cinder-quobyte-17a23e15-8f55-4afb-86aa-b119cb8f77e0" released by "delete_snapshot" :: held 3.165s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Created reservations ['0bff260f-befe-4f35-a082-71702fe281fe', '94ee3387-743e-4916-bd46-b5a8a3a94d91', '93238a9f-78ec-475f-93c4-51121cb232f1', '1140d809-b291-412e-be4f-ee11e37ea3e1'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:31 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Delete snapshot completed successfully.
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-650f2062-ca1c-47c0-b50e-31f2ba5d83b9 tempest-VolumesExtendTest-1391241516 None] Lock "cinder-c66f6188-9897-4d86-8570-fc598c034768-delete_snapshot" released by "delete_snapshot" :: held 3.314s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:31 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.info" returned: 0 in 0.657s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.421s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.998s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Creating offline snapshot a930411f-ff92-415c-8dff-4b0e02fdd78a of volume a93df2b6-2a50-4fdd-b94f-4724f0e95770 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:26:31 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4291ed07-615f-482a-935b-2d51461e517b tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Create snapshot completed successfully
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6e9760-93a3-4248-8a6e-82c3c9825051]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:31 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770
Jun 24 04:26:31 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Acquiring lock "cinder-17a23e15-8f55-4afb-86aa-b119cb8f77e0-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Lock "cinder-17a23e15-8f55-4afb-86aa-b119cb8f77e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Acquiring lock "cinder-quobyte-17a23e15-8f55-4afb-86aa-b119cb8f77e0" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:32 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Lock "cinder-quobyte-17a23e15-8f55-4afb-86aa-b119cb8f77e0" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:32 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770" returned: 0 in 0.802s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682d974-8867-42c5-b213-379ea486a3a7]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:32 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a 1G
Jun 24 04:26:32 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:32 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0
Jun 24 04:26:32 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "cinder-ac5a9242-28b7-428d-9aba-b1ef3fab6883-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-ac5a9242-28b7-428d-9aba-b1ef3fab6883-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "cinder-quobyte-63c92a78-38a7-40eb-8858-ade39bec3800" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-quobyte-63c92a78-38a7-40eb-8858-ade39bec3800" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "cinder-quobyte-ac5a9242-28b7-428d-9aba-b1ef3fab6883" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-quobyte-ac5a9242-28b7-428d-9aba-b1ef3fab6883" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Deleting offline snapshot ac5a9242-28b7-428d-9aba-b1ef3fab6883 of volume 63c92a78-38a7-40eb-8858-ade39bec3800 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] snapshot_file for this snap is: volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac379467-fc43-4810-a332-e0142ceaafbd]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:33 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0" returned: 0 in 0.859s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:33 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a 1G" returned: 0 in 0.896s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:33 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0
Jun 24 04:26:33 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:33 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883
Jun 24 04:26:33 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:33 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a
Jun 24 04:26:33 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:34 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-17a23e15-8f55-4afb-86aa-b119cb8f77e0" returned: 0 in 0.679s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Lock "cinder-quobyte-17a23e15-8f55-4afb-86aa-b119cb8f77e0" released by "delete_volume" :: held 1.612s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:34 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883" returned: 0 in 0.811s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63c92a78-38a7-40eb-8858-ade39bec3800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c367aef8-d700-40e4-80ab-d95535b74651]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:34 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a" returned: 0 in 0.756s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:34 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a is being set with open permissions: ugo+rw
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Created reservations ['7e11ed2a-0c56-4c4a-b420-1ce479ac7838', '058e2cd2-ced2-47c6-9a37-a816c6f9da30', '37516e02-51e6-4322-9406-a147238288a4', '9d40f6ed-e9af-4a9a-8831-55e32d7b5ff5'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:34 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a
Jun 24 04:26:34 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:34 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800
Jun 24 04:26:34 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:34 devstack sudo[108292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:34 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:34 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a" returned: 0 in 0.705s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:34 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.info
Jun 24 04:26:34 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:34 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.708s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:35 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800" returned: 0 in 0.840s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:35 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Deleted volume successfully.
Jun 24 04:26:35 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883
Jun 24 04:26:35 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-216080ff-541a-4410-9105-4c121dc10bdd tempest-VolumesExtendTest-1391241516 None] Lock "cinder-17a23e15-8f55-4afb-86aa-b119cb8f77e0-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:35 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.info" returned: 0 in 0.766s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:35 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.info is being set with open permissions: ugo+rw
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:35 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.info
Jun 24 04:26:35 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:35 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883" returned: 0 in 0.817s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:35 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883
Jun 24 04:26:35 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:36 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.info" returned: 0 in 0.714s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:36 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c29139f1-0f4b-45f4-96fb-c49a782115bb tempest-CinderUnicodeTest-676881283 None] Create snapshot completed successfully
Jun 24 04:26:36 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800.ac5a9242-28b7-428d-9aba-b1ef3fab6883" returned: 0 in 0.761s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-quobyte-ac5a9242-28b7-428d-9aba-b1ef3fab6883" released by "_delete_snapshot" :: held 3.346s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-quobyte-63c92a78-38a7-40eb-8858-ade39bec3800" released by "delete_snapshot" :: held 3.382s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:36 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Created reservations ['122ac4ba-fa09-4b43-ace0-b6ad88463f9e', 'dde3813c-0ec4-480b-b387-2f534957618a', 'd9c756af-3935-4179-8cc3-19b465f9c55a', 'af544e48-d001-4b5b-8d2f-4236bccbf97b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:36 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Delete snapshot completed successfully.
Jun 24 04:26:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b8c5761-85c8-4b8a-a4a6-dc3c6f527c5a tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-ac5a9242-28b7-428d-9aba-b1ef3fab6883-delete_snapshot" released by "delete_snapshot" :: held 3.539s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Acquiring lock "cinder-a930411f-ff92-415c-8dff-4b0e02fdd78a-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Lock "cinder-a930411f-ff92-415c-8dff-4b0e02fdd78a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Acquiring lock "cinder-quobyte-a93df2b6-2a50-4fdd-b94f-4724f0e95770" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Lock "cinder-quobyte-a93df2b6-2a50-4fdd-b94f-4724f0e95770" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Acquiring lock "cinder-quobyte-a930411f-ff92-415c-8dff-4b0e02fdd78a" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Lock "cinder-quobyte-a930411f-ff92-415c-8dff-4b0e02fdd78a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Deleting offline snapshot a930411f-ff92-415c-8dff-4b0e02fdd78a of volume a93df2b6-2a50-4fdd-b94f-4724f0e95770 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] snapshot_file for this snap is: volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef404d0a-ead1-4b32-af23-9467bf3c0b19]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:37 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a
Jun 24 04:26:37 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "cinder-63c92a78-38a7-40eb-8858-ade39bec3800-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-63c92a78-38a7-40eb-8858-ade39bec3800-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "cinder-quobyte-63c92a78-38a7-40eb-8858-ade39bec3800" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-quobyte-63c92a78-38a7-40eb-8858-ade39bec3800" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[562a38c9-1e57-452d-b949-be2558f69d7a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:37 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800
Jun 24 04:26:37 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Flow 'volume_create_manager' (70f108af-faa5-4a7c-aab5-dd08da346181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813d342f-befd-48d1-9304-1484e264206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813d342f-befd-48d1-9304-1484e264206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-288235292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9108075f-5110-4902-bd58-0bc17a9b6607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce4e7b89468427fa2027c7e59b76496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:38Z,use_quota=True,user_id='786d0ed2fa174ce185dc155ce6fe084f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cffeb9-7ccf-47b4-bdea-e50f1e9d9290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cffeb9-7ccf-47b4-bdea-e50f1e9d9290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959dd1e5-1eb3-4150-91f2-0ae0d7987b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959dd1e5-1eb3-4150-91f2-0ae0d7987b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9108075f-5110-4902-bd58-0bc17a9b6607', 'volume_name': 'volume-9108075f-5110-4902-bd58-0bc17a9b6607', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbd685a-75a4-4f3e-8d2f-5b3170478364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbd685a-75a4-4f3e-8d2f-5b3170478364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b592a4-243d-4715-a4ad-0fc0390cb8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Volume 9108075f-5110-4902-bd58-0bc17a9b6607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9108075f-5110-4902-bd58-0bc17a9b6607', 'volume_size': 1}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-288235292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9108075f-5110-4902-bd58-0bc17a9b6607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce4e7b89468427fa2027c7e59b76496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:38Z,use_quota=True,user_id='786d0ed2fa174ce185dc155ce6fe084f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Creating volume 9108075f-5110-4902-bd58-0bc17a9b6607 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:37 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:26:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:37 devstack sudo[108322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607 1073741824
Jun 24 04:26:37 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:38 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a" returned: 0 in 0.830s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3c3e45-f3ed-477c-a27a-4025994f6813]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:38 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770
Jun 24 04:26:38 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:38 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800" returned: 0 in 0.802s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:38 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800
Jun 24 04:26:38 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:38 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770" returned: 0 in 0.817s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:38 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607 1073741824" returned: 0 in 0.969s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:38 devstack sudo[108337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a
Jun 24 04:26:38 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:38 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607
Jun 24 04:26:38 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:39 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-63c92a78-38a7-40eb-8858-ade39bec3800" returned: 0 in 0.728s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-quobyte-63c92a78-38a7-40eb-8858-ade39bec3800" released by "delete_volume" :: held 1.621s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Created reservations ['48d81035-8323-47ca-acd4-5f739c5f0b92', '10eb7375-49d8-4d81-89dd-357ebb376cc9', '55849252-fcdf-4390-8ab0-3769ba411665', '63639655-0b4c-457e-815a-a50a2a5e7404'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:39 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:39 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:39 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607" returned: 0 in 0.711s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:39 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a" returned: 0 in 0.766s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b592a4-243d-4715-a4ad-0fc0390cb8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9108075f-5110-4902-bd58-0bc17a9b6607', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a9428-592d-4481-b366-4004a8ef8be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:39 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a
Jun 24 04:26:39 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:39 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Volume volume-9108075f-5110-4902-bd58-0bc17a9b6607 (9108075f-5110-4902-bd58-0bc17a9b6607): created successfully
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a9428-592d-4481-b366-4004a8ef8be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:39 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Flow 'volume_create_manager' (70f108af-faa5-4a7c-aab5-dd08da346181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:39 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-dafc42ea-cdfa-4c7e-b801-91bca9ccd3b0 tempest-VolumesNegativeTest-1517342808 None] Created volume successfully.
Jun 24 04:26:40 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.743s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:40 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Deleted volume successfully.
Jun 24 04:26:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2906ca0e-fd40-4684-8cba-cd25e077e58d tempest-VolumeSnapshotQuotasNegativeTestJSON-1123381084 None] Lock "cinder-63c92a78-38a7-40eb-8858-ade39bec3800-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:40 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770.a930411f-ff92-415c-8dff-4b0e02fdd78a" returned: 0 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Lock "cinder-quobyte-a930411f-ff92-415c-8dff-4b0e02fdd78a" released by "_delete_snapshot" :: held 3.298s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Lock "cinder-quobyte-a93df2b6-2a50-4fdd-b94f-4724f0e95770" released by "delete_snapshot" :: held 3.326s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:40 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Created reservations ['189e2eea-f9a1-4e36-b7ca-9552e9b91be9', 'b2215c52-9537-4720-a94f-f7dc48b7a1be', '61cd0376-2833-4ffa-b1f5-b60506487b82', '6a8510be-cc41-4631-8943-2b456bb5f04c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Delete snapshot completed successfully.
Jun 24 04:26:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0e29842f-0461-4cd0-8f81-1cd179e5639c tempest-CinderUnicodeTest-676881283 None] Lock "cinder-a930411f-ff92-415c-8dff-4b0e02fdd78a-delete_snapshot" released by "delete_snapshot" :: held 3.471s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Acquiring lock "cinder-a93df2b6-2a50-4fdd-b94f-4724f0e95770-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Lock "cinder-a93df2b6-2a50-4fdd-b94f-4724f0e95770-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Acquiring lock "cinder-quobyte-a93df2b6-2a50-4fdd-b94f-4724f0e95770" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Lock "cinder-quobyte-a93df2b6-2a50-4fdd-b94f-4724f0e95770" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:41 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6addb-7eec-4cfe-b9de-3f736bced9c2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:41 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770
Jun 24 04:26:41 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:42 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770" returned: 0 in 0.854s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:42 devstack sudo[108360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770
Jun 24 04:26:42 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:43 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a93df2b6-2a50-4fdd-b94f-4724f0e95770" returned: 0 in 0.661s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Lock "cinder-quobyte-a93df2b6-2a50-4fdd-b94f-4724f0e95770" released by "delete_volume" :: held 1.589s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Created reservations ['e0bbee66-09d2-460f-89c5-5a7f4e1d3ee9', '704a830d-6e0d-4685-b5d0-5dceace2e534', 'd80f01e8-9b63-4a32-8aec-25ba5a7f91bb', 'e9b8991e-0d22-4808-9331-e634112a9172'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:43 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:43 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Acquiring lock "cinder-6f11538b-df41-4b99-bed2-5be1a6551946-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Lock "cinder-6f11538b-df41-4b99-bed2-5be1a6551946-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Acquiring lock "cinder-quobyte-6f11538b-df41-4b99-bed2-5be1a6551946" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Lock "cinder-quobyte-6f11538b-df41-4b99-bed2-5be1a6551946" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2bab77-acc2-45a2-ac22-b1f0ad3f801d]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:43 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946
Jun 24 04:26:43 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:43 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.710s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Deleted volume successfully.
Jun 24 04:26:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b2996c45-b90b-40af-a2db-20f2fd68f482 tempest-CinderUnicodeTest-676881283 None] Lock "cinder-a93df2b6-2a50-4fdd-b94f-4724f0e95770-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:44 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946" returned: 0 in 0.891s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:44 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946
Jun 24 04:26:44 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:45 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:45 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:45 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6f11538b-df41-4b99-bed2-5be1a6551946" returned: 0 in 0.798s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Lock "cinder-quobyte-6f11538b-df41-4b99-bed2-5be1a6551946" released by "delete_volume" :: held 1.744s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Created reservations ['a40540af-9627-4f25-bd10-dd16a3daf264', 'a8d3bd80-0374-4119-a7b4-fbb5a2cd9ded', 'f6011be2-d1b5-422a-8880-4dbd5091e314', '1adf6e7d-2b10-4a3a-af08-184e1f1b3213'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:45 devstack sudo[108377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:26:45 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:46 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.820s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:26:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:26:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:26:46 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.977s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Deleted volume successfully.
Jun 24 04:26:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d7665206-150d-4fd2-b336-7e7e023b6460 tempest-CinderUnicodeTest-676881283 None] Lock "cinder-6f11538b-df41-4b99-bed2-5be1a6551946-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:55 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=57,cinder:INSERT=17,cinder:UPDATE=73,cinder:DELETE=3 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:26:56 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=67,cinder:SELECT=57,cinder:DELETE=9,cinder:INSERT=19 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:27:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Acquiring lock "cinder-9108075f-5110-4902-bd58-0bc17a9b6607-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Lock "cinder-9108075f-5110-4902-bd58-0bc17a9b6607-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Acquiring lock "cinder-quobyte-9108075f-5110-4902-bd58-0bc17a9b6607" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Lock "cinder-quobyte-9108075f-5110-4902-bd58-0bc17a9b6607" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:15 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c920a8-512d-4eb1-9216-a36f3e011984]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:15 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607
Jun 24 04:27:15 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:16 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607" returned: 0 in 0.806s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:16 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607
Jun 24 04:27:16 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:17 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9108075f-5110-4902-bd58-0bc17a9b6607" returned: 0 in 0.652s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Lock "cinder-quobyte-9108075f-5110-4902-bd58-0bc17a9b6607" released by "delete_volume" :: held 1.500s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Created reservations ['4957bd0f-8e65-4500-9a26-6b8bf77c9bf2', '2e4943e5-2cd2-4beb-8f16-cab15241c221', '519ce5b3-b6f1-49b7-8e24-bd0f00b7cf3f', '5759ee19-4b14-48bf-974c-381fc0b46a63'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:17 devstack sudo[108616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:27:17 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:18 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.690s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:18 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:18 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Deleted volume successfully.
Jun 24 04:27:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-081c1d84-6622-4445-a763-50c0ba1a7043 tempest-VolumesNegativeTest-1517342808 None] Lock "cinder-9108075f-5110-4902-bd58-0bc17a9b6607-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (f03e176a-4d57-45da-a264-bb17c36fc858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8212e76d-d1d5-4139-bdad-8fb90a0d5209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8212e76d-d1d5-4139-bdad-8fb90a0d5209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-165965720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693a87b2-db77-403f-a15e-e7372eb6f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:24Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fbc5be-c6be-4a6f-a106-7b8e90410597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fbc5be-c6be-4a6f-a106-7b8e90410597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce3c0d-53f2-476d-8f7b-220cdba70f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce3c0d-53f2-476d-8f7b-220cdba70f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693a87b2-db77-403f-a15e-e7372eb6f616', 'volume_name': 'volume-693a87b2-db77-403f-a15e-e7372eb6f616', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51c319f-ad77-4ece-8799-02d911749881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51c319f-ad77-4ece-8799-02d911749881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34533522-0931-4ecf-bee1-d994e206db01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:23 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Volume 693a87b2-db77-403f-a15e-e7372eb6f616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693a87b2-db77-403f-a15e-e7372eb6f616', 'volume_size': 1}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-165965720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693a87b2-db77-403f-a15e-e7372eb6f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:24Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Creating volume 693a87b2-db77-403f-a15e-e7372eb6f616 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:23 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:27:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:23 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616 1073741824
Jun 24 04:27:23 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:24 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616 1073741824" returned: 0 in 0.980s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:24 devstack sudo[108711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616
Jun 24 04:27:24 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:25 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616" returned: 0 in 0.852s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34533522-0931-4ecf-bee1-d994e206db01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693a87b2-db77-403f-a15e-e7372eb6f616', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54df7ad-df77-4017-b9e1-420b1cc1b8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:25 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Volume volume-693a87b2-db77-403f-a15e-e7372eb6f616 (693a87b2-db77-403f-a15e-e7372eb6f616): created successfully
Jun 24 04:27:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54df7ad-df77-4017-b9e1-420b1cc1b8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (f03e176a-4d57-45da-a264-bb17c36fc858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:25 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f61e2157-404c-4f87-b104-322e5f78b4dd tempest-VolumesActionsTest-1098181211 None] Created volume successfully.
Jun 24 04:27:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-5b940454-70cd-4019-8deb-d95b0f5e50ad tempest-VolumesActionsTest-1098181211 None] Acquiring lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616" by "attach_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-5b940454-70cd-4019-8deb-d95b0f5e50ad tempest-VolumesActionsTest-1098181211 None] Lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616" acquired by "attach_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-5b940454-70cd-4019-8deb-d95b0f5e50ad tempest-VolumesActionsTest-1098181211 None] Attaching volume 693a87b2-db77-403f-a15e-e7372eb6f616 to instance 233a9bda-ee49-4d68-9e0d-c32438c89456 at mountpoint /dev/vdb on host None.
Jun 24 04:27:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-5b940454-70cd-4019-8deb-d95b0f5e50ad tempest-VolumesActionsTest-1098181211 None] Attach volume completed successfully.
Jun 24 04:27:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-5b940454-70cd-4019-8deb-d95b0f5e50ad tempest-VolumesActionsTest-1098181211 None] Lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616" released by "attach_volume" :: held 0.128s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:28 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-797b4675-5989-4ed1-8f48-961c45a70640 tempest-VolumesActionsTest-883201987 None] Terminate volume connection completed successfully.
Jun 24 04:27:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-797b4675-5989-4ed1-8f48-961c45a70640 tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-detach_volume" by "detach_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-797b4675-5989-4ed1-8f48-961c45a70640 tempest-VolumesActionsTest-883201987 None] Lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:28 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-797b4675-5989-4ed1-8f48-961c45a70640 tempest-VolumesActionsTest-883201987 None] Detaching volume 693a87b2-db77-403f-a15e-e7372eb6f616 from instance 233a9bda-ee49-4d68-9e0d-c32438c89456.
Jun 24 04:27:28 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-797b4675-5989-4ed1-8f48-961c45a70640 tempest-VolumesActionsTest-883201987 None] Detach volume completed successfully.
Jun 24 04:27:28 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-797b4675-5989-4ed1-8f48-961c45a70640 tempest-VolumesActionsTest-883201987 None] Lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ff6c7898-640c-4703-844f-11096f222af2 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-detach_volume" by "detach_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ff6c7898-640c-4703-844f-11096f222af2 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:29 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ff6c7898-640c-4703-844f-11096f222af2 tempest-VolumesActionsTest-1098181211 None] Volume detach called, but volume not attached.
Jun 24 04:27:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ff6c7898-640c-4703-844f-11096f222af2 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "cinder-quobyte-693a87b2-db77-403f-a15e-e7372eb6f616" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-quobyte-693a87b2-db77-403f-a15e-e7372eb6f616" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:30 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[175a4211-b23a-46b4-88c4-df512e572aff]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:30 devstack sudo[108715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616
Jun 24 04:27:30 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:31 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616" returned: 0 in 0.824s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:31 devstack sudo[108721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616
Jun 24 04:27:31 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:31 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-693a87b2-db77-403f-a15e-e7372eb6f616" returned: 0 in 0.705s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-quobyte-693a87b2-db77-403f-a15e-e7372eb6f616" released by "delete_volume" :: held 1.603s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:31 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Created reservations ['3a1b707d-14f1-4435-b105-45b50616ba9b', 'c198861e-bfad-42f4-ae4c-106216b0e7ce', '67e8830e-8f70-4456-a1ff-a8cffc2139d1', 'cbdc207e-2973-445a-b388-3095c1b00777'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:32 devstack sudo[108724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:27:32 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:33 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.294s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Deleted volume successfully.
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d59ec6fd-ee07-46d7-8c2f-0504f5bf9709 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-693a87b2-db77-403f-a15e-e7372eb6f616-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (59a82950-fb59-481d-9824-e86a6ad08e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4dc6a57-7af7-40fe-aa9a-f2daad8746ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4dc6a57-7af7-40fe-aa9a-f2daad8746ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-322757996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ef697-f112-4406-a344-3f3b318ad718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376cd848de614b1fac3a7ff64d6a41fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:34Z,use_quota=True,user_id='6097361dd51b4f028c836719b385aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5184f7d6-a5d9-49de-9a34-e8ff5384da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5184f7d6-a5d9-49de-9a34-e8ff5384da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2984e97-2717-4ef5-920f-4115d6246476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2984e97-2717-4ef5-920f-4115d6246476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43ef697-f112-4406-a344-3f3b318ad718', 'volume_name': 'volume-b43ef697-f112-4406-a344-3f3b318ad718', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35864c85-1dd3-444c-bd44-a81e5bb6427e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35864c85-1dd3-444c-bd44-a81e5bb6427e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbddb00-02c6-4ea0-a252-a5228976e599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:34 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Volume b43ef697-f112-4406-a344-3f3b318ad718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43ef697-f112-4406-a344-3f3b318ad718', 'volume_size': 1}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-322757996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ef697-f112-4406-a344-3f3b318ad718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376cd848de614b1fac3a7ff64d6a41fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:34Z,use_quota=True,user_id='6097361dd51b4f028c836719b385aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Creating volume b43ef697-f112-4406-a344-3f3b318ad718 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:34 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:34 devstack sudo[108769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718 1073741824
Jun 24 04:27:34 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:34 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718 1073741824" returned: 0 in 0.898s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:34 devstack sudo[108788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718
Jun 24 04:27:34 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:35 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718" returned: 0 in 0.683s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbddb00-02c6-4ea0-a252-a5228976e599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43ef697-f112-4406-a344-3f3b318ad718', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d612dd0-7221-45c0-af0d-c59884fb0450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:35 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Volume volume-b43ef697-f112-4406-a344-3f3b318ad718 (b43ef697-f112-4406-a344-3f3b318ad718): created successfully
Jun 24 04:27:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d612dd0-7221-45c0-af0d-c59884fb0450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (59a82950-fb59-481d-9824-e86a6ad08e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:35 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-221dfcba-fdad-4235-92dd-a990c66d030f tempest-VolumesSnapshotTestJSON-1098625906 None] Created volume successfully.
Jun 24 04:27:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Creating offline snapshot 814bff1d-4495-4ab3-94d9-3f55b2bb9e0c of volume b43ef697-f112-4406-a344-3f3b318ad718 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:27:36 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e10eef-4350-4a02-8d7e-5e6e208ed972]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:36 devstack sudo[108794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718
Jun 24 04:27:36 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:37 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718" returned: 0 in 0.759s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:37 devstack sudo[108799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c 1G
Jun 24 04:27:37 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:37 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c 1G" returned: 0 in 0.798s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43ef697-f112-4406-a344-3f3b318ad718 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:37 devstack sudo[108804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43ef697-f112-4406-a344-3f3b318ad718 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c
Jun 24 04:27:37 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:38 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43ef697-f112-4406-a344-3f3b318ad718 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c" returned: 0 in 0.776s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:38 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c is being set with open permissions: ugo+rw
Jun 24 04:27:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:38 devstack sudo[108809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c
Jun 24 04:27:38 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:39 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c" returned: 0 in 0.691s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:39 devstack sudo[108812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.info
Jun 24 04:27:39 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:40 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.info" returned: 0 in 0.651s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:40 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.info is being set with open permissions: ugo+rw
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:40 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.info
Jun 24 04:27:40 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:40 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.info" returned: 0 in 0.635s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.419s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0e741a33-7bf7-4711-825f-ddfa9eb8a0af tempest-VolumesSnapshotTestJSON-1098625906 None] Create snapshot completed successfully
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (5b6a5fa6-6c49-456e-9168-aacd08f323be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03f8583-93be-468f-8010-1952dc8a68dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03f8583-93be-468f-8010-1952dc8a68dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1125896400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:41Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdc47b9-a8cf-41cf-bf51-92b7b5149857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdc47b9-a8cf-41cf-bf51-92b7b5149857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e23a56b-a3c8-4d47-baae-f34da861d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e23a56b-a3c8-4d47-baae-f34da861d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba', 'volume_name': 'volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53dda4e6-b179-4f10-87d1-d1e421c400db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53dda4e6-b179-4f10-87d1-d1e421c400db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2a8c9b-0217-4f2d-baf6-e876a350c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:40 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Volume 8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba', 'volume_size': 1}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1125896400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:41Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Creating volume 8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:40 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:27:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:40 devstack sudo[108818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba 1073741824
Jun 24 04:27:40 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-814bff1d-4495-4ab3-94d9-3f55b2bb9e0c-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-814bff1d-4495-4ab3-94d9-3f55b2bb9e0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-b43ef697-f112-4406-a344-3f3b318ad718" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-b43ef697-f112-4406-a344-3f3b318ad718" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-814bff1d-4495-4ab3-94d9-3f55b2bb9e0c" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-814bff1d-4495-4ab3-94d9-3f55b2bb9e0c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Deleting offline snapshot 814bff1d-4495-4ab3-94d9-3f55b2bb9e0c of volume b43ef697-f112-4406-a344-3f3b318ad718 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] snapshot_file for this snap is: volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e054c-6611-41c6-836f-ba22fb4fd6ab]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:41 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba 1073741824" returned: 0 in 0.867s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:41 devstack sudo[108824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c
Jun 24 04:27:41 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:41 devstack sudo[108826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba
Jun 24 04:27:41 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:42 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c" returned: 0 in 0.743s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b43ef697-f112-4406-a344-3f3b318ad718(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[616915c1-697c-40fb-a596-c6f064e45f2f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:42 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba" returned: 0 in 0.669s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:42 devstack sudo[108832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718
Jun 24 04:27:42 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2a8c9b-0217-4f2d-baf6-e876a350c339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7940a24c-c654-4f3d-a571-ea531eeebe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:42 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Volume volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba (8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba): created successfully
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7940a24c-c654-4f3d-a571-ea531eeebe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (5b6a5fa6-6c49-456e-9168-aacd08f323be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-21cc578b-d608-464d-bb05-49eb6c17f708 tempest-VolumesActionsTest-1098181211 None] Created volume successfully.
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Lock "cinder-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-quobyte-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Lock "cinder-quobyte-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bda781-01bf-451e-90e8-8ac3f445de90]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:43 devstack sudo[108834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba
Jun 24 04:27:43 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:43 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718" returned: 0 in 0.791s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:43 devstack sudo[108839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c
Jun 24 04:27:43 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:43 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba" returned: 0 in 0.783s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:43 devstack sudo[108847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba
Jun 24 04:27:43 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:44 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c" returned: 0 in 0.751s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:44 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c
Jun 24 04:27:44 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:44 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba" returned: 0 in 0.659s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Lock "cinder-quobyte-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba" released by "delete_volume" :: held 1.500s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Created reservations ['82456544-edbe-497b-8685-2900e8f49ab2', 'cfbc7b17-62da-4f56-bc47-f7ae593e2a0e', '254392eb-59a5-4555-9206-d7f5cf69f18f', '0a849daf-7957-444c-b369-504c1fecf7b4'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:44 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718.814bff1d-4495-4ab3-94d9-3f55b2bb9e0c" returned: 0 in 0.651s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-814bff1d-4495-4ab3-94d9-3f55b2bb9e0c" released by "_delete_snapshot" :: held 3.088s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-b43ef697-f112-4406-a344-3f3b318ad718" released by "delete_snapshot" :: held 3.115s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:44 devstack sudo[108853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:27:44 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Created reservations ['1e34d373-fd34-4425-8d81-5d21c8902a7a', '0217770f-e0da-4ada-a4c4-edc15b2f32c5', '5aeee1c8-0cb5-40c6-b8bd-a3808c1c573a', 'd6fd3257-76b3-4118-89f9-3bce4c0143c1'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:44 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Delete snapshot completed successfully.
Jun 24 04:27:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-66a425dc-f54b-498c-afb1-311807e09655 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-814bff1d-4495-4ab3-94d9-3f55b2bb9e0c-delete_snapshot" released by "delete_snapshot" :: held 3.288s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:45 devstack sudo[108855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:27:45 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:45 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.734s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Deleted volume successfully.
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-7537b667-364d-46a3-be25-94e081dae102 tempest-VolumesActionsTest-883201987 None] Lock "cinder-8912cacc-8d5a-4fa8-b7aa-56faaa9cf3ba-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (833743c5-5d63-4f5d-94a2-b281e6f3afa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d77a59-0f40-4499-b6e4-45fe6f3d3421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d77a59-0f40-4499-b6e4-45fe6f3d3421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-994227956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2ca37d-3283-4501-82d7-808f471f206f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:46Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05849c6-a46d-40a0-9ce2-91abed108f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05849c6-a46d-40a0-9ce2-91abed108f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:45 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e94fe2b-e793-47a0-802d-42d9750ff26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e94fe2b-e793-47a0-802d-42d9750ff26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2ca37d-3283-4501-82d7-808f471f206f', 'volume_name': 'volume-ea2ca37d-3283-4501-82d7-808f471f206f', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e09c15b-acbd-4a1e-961c-e7106c9896d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e09c15b-acbd-4a1e-961c-e7106c9896d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902c383b-0abe-418e-99a5-5f9b1656b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:45 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Volume ea2ca37d-3283-4501-82d7-808f471f206f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2ca37d-3283-4501-82d7-808f471f206f', 'volume_size': 1}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-994227956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2ca37d-3283-4501-82d7-808f471f206f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:46Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Creating volume ea2ca37d-3283-4501-82d7-808f471f206f {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:45 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:27:46 devstack sudo[108859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f 1073741824
Jun 24 04:27:46 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (f78fd806-4c36-4789-82dd-23dbca3f3746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdc04e8-ffc7-4223-a599-51cdf64c4bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdc04e8-ffc7-4223-a599-51cdf64c4bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1534866060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf298c7b-515b-4328-986d-c83b3768ac03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376cd848de614b1fac3a7ff64d6a41fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:46Z,use_quota=True,user_id='6097361dd51b4f028c836719b385aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4727b14-a5a5-425c-9874-44538561841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4727b14-a5a5-425c-9874-44538561841f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73547aff-bf5e-4337-b53b-f242aba8d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73547aff-bf5e-4337-b53b-f242aba8d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf298c7b-515b-4328-986d-c83b3768ac03', 'volume_name': 'volume-cf298c7b-515b-4328-986d-c83b3768ac03', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6013446-a25b-4886-8983-79eba5594180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6013446-a25b-4886-8983-79eba5594180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd27182-d2a2-4e53-8233-da7da7aeddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Volume cf298c7b-515b-4328-986d-c83b3768ac03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf298c7b-515b-4328-986d-c83b3768ac03', 'volume_size': 1}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:46 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f 1073741824" returned: 0 in 0.829s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:46 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f
Jun 24 04:27:46 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:47 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f" returned: 0 in 0.640s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1534866060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf298c7b-515b-4328-986d-c83b3768ac03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376cd848de614b1fac3a7ff64d6a41fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:46Z,use_quota=True,user_id='6097361dd51b4f028c836719b385aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Creating volume cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:47 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902c383b-0abe-418e-99a5-5f9b1656b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2ca37d-3283-4501-82d7-808f471f206f', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:47 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 1073741824
Jun 24 04:27:47 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51b7ed9-de52-4eb3-80c4-0461ce8a9285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:47 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Volume volume-ea2ca37d-3283-4501-82d7-808f471f206f (ea2ca37d-3283-4501-82d7-808f471f206f): created successfully
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51b7ed9-de52-4eb3-80c4-0461ce8a9285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (833743c5-5d63-4f5d-94a2-b281e6f3afa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:47 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-72da57d2-d155-49c5-8730-dee9e55a0475 tempest-VolumesActionsTest-1098181211 None] Created volume successfully.
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-ea2ca37d-3283-4501-82d7-808f471f206f-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Lock "cinder-ea2ca37d-3283-4501-82d7-808f471f206f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-quobyte-ea2ca37d-3283-4501-82d7-808f471f206f" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Lock "cinder-quobyte-ea2ca37d-3283-4501-82d7-808f471f206f" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4950bb34-b9bc-491b-9bd4-1eec45ccbe13]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:48 devstack sudo[108873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f
Jun 24 04:27:48 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:48 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 1073741824" returned: 0 in 0.852s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:48 devstack sudo[108876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03
Jun 24 04:27:48 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:48 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f" returned: 0 in 0.796s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:48 devstack sudo[108882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f
Jun 24 04:27:48 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:49 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03" returned: 0 in 0.655s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd27182-d2a2-4e53-8233-da7da7aeddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf298c7b-515b-4328-986d-c83b3768ac03', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34ce15b-082b-438c-b2d1-1433d8fb5d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Volume volume-cf298c7b-515b-4328-986d-c83b3768ac03 (cf298c7b-515b-4328-986d-c83b3768ac03): created successfully
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34ce15b-082b-438c-b2d1-1433d8fb5d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (f78fd806-4c36-4789-82dd-23dbca3f3746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0e40b259-2872-46cf-b1e0-65c8efc3d9db tempest-VolumesSnapshotTestJSON-1098625906 None] Created volume successfully.
Jun 24 04:27:49 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-ea2ca37d-3283-4501-82d7-808f471f206f" returned: 0 in 0.677s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Lock "cinder-quobyte-ea2ca37d-3283-4501-82d7-808f471f206f" released by "delete_volume" :: held 1.520s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Created reservations ['59d8a65e-2d6d-4f06-9c0e-cf137c29f09a', 'b23f886f-0138-484d-994a-bd05a417025d', 'e155f1b8-b152-4d50-9073-cb09f8775321', '82e65aa6-9bf0-4b91-a451-6ef9f9241a98'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Creating offline snapshot 7dbbd406-35f7-4121-b177-a0ccc8dd5208 of volume cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8765f837-fdb4-4e4d-8265-9484478fa665]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:49 devstack sudo[108886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:27:49 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:49 devstack sudo[108885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03
Jun 24 04:27:49 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:50 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.701s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:50 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Deleted volume successfully.
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-16f699ea-fd89-4528-86fe-2371b642061f tempest-VolumesActionsTest-883201987 None] Lock "cinder-ea2ca37d-3283-4501-82d7-808f471f206f-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:50 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03" returned: 0 in 0.823s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:50 devstack sudo[108893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 1G
Jun 24 04:27:50 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (2b6f4b92-63e5-4d38-a5f4-d4f680c57901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9561f23c-0a63-45a7-802d-e67c3457ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9561f23c-0a63-45a7-802d-e67c3457ca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1170027030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb2be45-cb27-4f9c-a802-8bb62a647780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:51Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58e52c0-5ba6-40e9-b0a0-e99cb99c5852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58e52c0-5ba6-40e9-b0a0-e99cb99c5852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0415f3-fe0d-4bf6-afab-e5e125bfe7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0415f3-fe0d-4bf6-afab-e5e125bfe7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb2be45-cb27-4f9c-a802-8bb62a647780', 'volume_name': 'volume-6fb2be45-cb27-4f9c-a802-8bb62a647780', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2083b8cb-9e97-4d87-97d9-fe2d584e95a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2083b8cb-9e97-4d87-97d9-fe2d584e95a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64cc89e-030e-4fa8-9b14-4c3ff094f3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:50 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Volume 6fb2be45-cb27-4f9c-a802-8bb62a647780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb2be45-cb27-4f9c-a802-8bb62a647780', 'volume_size': 1}
Jun 24 04:27:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:51 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 1G" returned: 0 in 0.796s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf298c7b-515b-4328-986d-c83b3768ac03 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:51 devstack sudo[108899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf298c7b-515b-4328-986d-c83b3768ac03 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208
Jun 24 04:27:51 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:52 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf298c7b-515b-4328-986d-c83b3768ac03 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208" returned: 0 in 0.667s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:52 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 is being set with open permissions: ugo+rw
Jun 24 04:27:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:52 devstack sudo[108904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208
Jun 24 04:27:52 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:52 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208" returned: 0 in 0.658s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:52 devstack sudo[108907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.info
Jun 24 04:27:52 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:53 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.info" returned: 0 in 0.646s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:53 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.info is being set with open permissions: ugo+rw
Jun 24 04:27:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:53 devstack sudo[108910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.info
Jun 24 04:27:53 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:54 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.info" returned: 0 in 0.643s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.319s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.104s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1170027030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb2be45-cb27-4f9c-a802-8bb62a647780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:51Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Creating volume 6fb2be45-cb27-4f9c-a802-8bb62a647780 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:54 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:54 devstack sudo[108913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780 1073741824
Jun 24 04:27:54 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:54 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e8a528bb-538d-495b-aa75-2697c850b92e tempest-VolumesSnapshotTestJSON-1098625906 None] Create snapshot completed successfully
Jun 24 04:27:54 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780 1073741824" returned: 0 in 0.837s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:54 devstack sudo[108918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780
Jun 24 04:27:54 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (12ba033f-78d0-4956-8af9-2bce5086f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f693ec49-7a18-4225-a33e-70a7c4017709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f693ec49-7a18-4225-a33e-70a7c4017709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-858816128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fe0010-2e89-4647-852b-b7989ef25dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376cd848de614b1fac3a7ff64d6a41fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7dbbd406-35f7-4121-b177-a0ccc8dd5208,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:55Z,use_quota=True,user_id='6097361dd51b4f028c836719b385aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3d3d78-3723-4a16-bf25-4f0595cd569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3d3d78-3723-4a16-bf25-4f0595cd569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9b411e-fa8d-41be-bd88-e60fb4fbdb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9b411e-fa8d-41be-bd88-e60fb4fbdb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27fe0010-2e89-4647-852b-b7989ef25dd3', 'volume_name': 'volume-27fe0010-2e89-4647-852b-b7989ef25dd3', 'volume_size': 2, 'snapshot_id': '7dbbd406-35f7-4121-b177-a0ccc8dd5208'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163a4f7d-96fe-41b2-83d0-4dc045a531f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163a4f7d-96fe-41b2-83d0-4dc045a531f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac592df-d528-4fff-8036-da74be34b033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:55 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume 27fe0010-2e89-4647-852b-b7989ef25dd3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27fe0010-2e89-4647-852b-b7989ef25dd3', 'volume_size': 2, 'snapshot_id': '7dbbd406-35f7-4121-b177-a0ccc8dd5208'}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:55 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780" returned: 0 in 0.755s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.095s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-7dbbd406-35f7-4121-b177-a0ccc8dd5208-27fe0010-2e89-4647-852b-b7989ef25dd3" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64cc89e-030e-4fa8-9b14-4c3ff094f3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb2be45-cb27-4f9c-a802-8bb62a647780', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19389fc1-892e-4019-b14b-58adee52aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-7dbbd406-35f7-4121-b177-a0ccc8dd5208-27fe0010-2e89-4647-852b-b7989ef25dd3" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Creating volume 27fe0010-2e89-4647-852b-b7989ef25dd3 from snapshot 7dbbd406-35f7-4121-b177-a0ccc8dd5208 {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-27fe0010-2e89-4647-852b-b7989ef25dd3" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-27fe0010-2e89-4647-852b-b7989ef25dd3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] snapshot: 7dbbd406-35f7-4121-b177-a0ccc8dd5208, volume: 27fe0010-2e89-4647-852b-b7989ef25dd3,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:27:55 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Volume volume-6fb2be45-cb27-4f9c-a802-8bb62a647780 (6fb2be45-cb27-4f9c-a802-8bb62a647780): created successfully
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19389fc1-892e-4019-b14b-58adee52aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (2b6f4b92-63e5-4d38-a5f4-d4f680c57901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:55 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0e7cea39-c788-4b07-8d7f-1cab915b0c46 tempest-VolumesActionsTest-1098181211 None] Created volume successfully.
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eb1781-c4aa-422e-8028-abeb54b51391]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:55 devstack sudo[108927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208
Jun 24 04:27:55 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-6fb2be45-cb27-4f9c-a802-8bb62a647780-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Lock "cinder-6fb2be45-cb27-4f9c-a802-8bb62a647780-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-quobyte-6fb2be45-cb27-4f9c-a802-8bb62a647780" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Lock "cinder-quobyte-6fb2be45-cb27-4f9c-a802-8bb62a647780" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[32214d79-857a-470a-adcc-3851cb871e3a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:56 devstack sudo[108930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780
Jun 24 04:27:56 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:56 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208" returned: 0 in 0.788s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf298c7b-515b-4328-986d-c83b3768ac03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c561f163-ed7f-49f8-9391-ea2d1820c4bb]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:56 devstack sudo[108935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03
Jun 24 04:27:56 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:57 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780" returned: 0 in 0.772s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:57 devstack sudo[108940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780
Jun 24 04:27:57 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:57 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03" returned: 0 in 0.758s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3 not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:57 devstack sudo[108945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3
Jun 24 04:27:57 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:57 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6fb2be45-cb27-4f9c-a802-8bb62a647780" returned: 0 in 0.655s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Lock "cinder-quobyte-6fb2be45-cb27-4f9c-a802-8bb62a647780" released by "delete_volume" :: held 1.479s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Created reservations ['29a1bc96-4e2d-4a37-a1d5-f9d881574716', '5c609549-ce62-442c-9e08-ad82ba07e678', '7bb5888a-07b0-4756-9ad5-77ff131f34f5', '4ee9b5df-1a67-4af9-a1e7-fcd58b74a9d0'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:57 devstack sudo[108951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:27:58 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:59 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.101s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:59 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Deleted volume successfully.
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4155f77b-59c8-46d8-9cce-da685a383f71 tempest-VolumesActionsTest-883201987 None] Lock "cinder-6fb2be45-cb27-4f9c-a802-8bb62a647780-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (50faeb33-d54a-4b4f-8cdc-70b2775cb65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ba75b-8666-4b8a-97a9-405da382df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ba75b-8666-4b8a-97a9-405da382df9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1529601121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f96c9ac-e35c-44e6-b2e0-fe10b2db6489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:00Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39673951-8390-402f-8a46-eef1b6b581ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39673951-8390-402f-8a46-eef1b6b581ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d23c3b8-9e96-4421-b0c6-44adb6924887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d23c3b8-9e96-4421-b0c6-44adb6924887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f96c9ac-e35c-44e6-b2e0-fe10b2db6489', 'volume_name': 'volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18334c72-b0c4-4ef9-910a-85f31b4b292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18334c72-b0c4-4ef9-910a-85f31b4b292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e23229-30aa-4a8a-b453-1800f9bcdb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:59 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Volume 9f96c9ac-e35c-44e6-b2e0-fe10b2db6489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489', 'volume_size': 1}
Jun 24 04:27:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:02 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3" returned: 0 in 4.879s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:02 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d3daad-c8d1-478e-affa-7694ee3e1474]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:02 devstack sudo[108964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03
Jun 24 04:28:02 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:03 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03" returned: 0 in 0.958s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:28:03 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Converted 1024.00 MB image at 209.84 MB/s
Jun 24 04:28:03 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3 is being set with open permissions: ugo+rw
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:03 devstack sudo[108970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3
Jun 24 04:28:03 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:03 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3" returned: 0 in 0.642s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-27fe0010-2e89-4647-852b-b7989ef25dd3" released by "_copy_volume_from_snapshot" :: held 8.133s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-7dbbd406-35f7-4121-b177-a0ccc8dd5208-27fe0010-2e89-4647-852b-b7989ef25dd3" released by "_create_volume_from_snapshot" :: held 8.162s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.190s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.945s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1529601121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f96c9ac-e35c-44e6-b2e0-fe10b2db6489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:00Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Creating volume 9f96c9ac-e35c-44e6-b2e0-fe10b2db6489 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:03 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:03 devstack sudo[108973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489 1073741824
Jun 24 04:28:03 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac592df-d528-4fff-8036-da74be34b033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fe0010-2e89-4647-852b-b7989ef25dd3', 'volume_size': 2, 'snapshot_id': '7dbbd406-35f7-4121-b177-a0ccc8dd5208'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd4db11-fbe5-4a0c-8a88-459aa553d638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:03 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume volume-27fe0010-2e89-4647-852b-b7989ef25dd3 (27fe0010-2e89-4647-852b-b7989ef25dd3): created successfully
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd4db11-fbe5-4a0c-8a88-459aa553d638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (12ba033f-78d0-4956-8af9-2bce5086f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ce478c16-e4c3-45af-9e41-1df978c5d2d4 tempest-VolumesSnapshotTestJSON-1098625906 None] Created volume successfully.
Jun 24 04:28:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-27fe0010-2e89-4647-852b-b7989ef25dd3-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-27fe0010-2e89-4647-852b-b7989ef25dd3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-27fe0010-2e89-4647-852b-b7989ef25dd3" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-27fe0010-2e89-4647-852b-b7989ef25dd3" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1f77da-b323-4c82-8d88-c9d309920656]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:04 devstack sudo[108977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3
Jun 24 04:28:04 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:04 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489 1073741824" returned: 0 in 0.869s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:04 devstack sudo[108980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489
Jun 24 04:28:04 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:05 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3" returned: 0 in 0.763s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:05 devstack sudo[108987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3
Jun 24 04:28:05 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:05 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489" returned: 0 in 0.656s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e23229-30aa-4a8a-b453-1800f9bcdb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea30bbe8-9924-45a1-a760-d497b881d7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:05 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Volume volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489 (9f96c9ac-e35c-44e6-b2e0-fe10b2db6489): created successfully
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea30bbe8-9924-45a1-a760-d497b881d7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (50faeb33-d54a-4b4f-8cdc-70b2775cb65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:05 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1b2644bb-acd7-40d5-88b6-ee99d8b53304 tempest-VolumesActionsTest-1098181211 None] Created volume successfully.
Jun 24 04:28:05 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-27fe0010-2e89-4647-852b-b7989ef25dd3" returned: 0 in 0.636s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-27fe0010-2e89-4647-852b-b7989ef25dd3" released by "delete_volume" :: held 1.447s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:05 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Created reservations ['1664c5da-83db-4b96-a416-3f36789e48fb', 'ef06ab84-2af1-4eb8-8088-f61c2317cc01', '18e399c7-7e62-4106-8f11-01a65884d7ca', 'c14978cc-589c-4f08-810f-15e86fa764c3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:06 devstack sudo[108991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:06 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Lock "cinder-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Acquiring lock "cinder-quobyte-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Lock "cinder-quobyte-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1f808-9e28-4cd4-b6d7-7ca7c193cb48]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:06 devstack sudo[108994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489
Jun 24 04:28:06 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-7dbbd406-35f7-4121-b177-a0ccc8dd5208-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:06 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.645s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-7dbbd406-35f7-4121-b177-a0ccc8dd5208-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-cf298c7b-515b-4328-986d-c83b3768ac03" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Deleted volume successfully.
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=82,cinder:SELECT=83,cinder:INSERT=23,cinder:DELETE=7 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-cf298c7b-515b-4328-986d-c83b3768ac03" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-7dbbd406-35f7-4121-b177-a0ccc8dd5208" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-7dbbd406-35f7-4121-b177-a0ccc8dd5208" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Deleting offline snapshot 7dbbd406-35f7-4121-b177-a0ccc8dd5208 of volume cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] snapshot_file for this snap is: volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-22d74cb2-b042-4b8b-bd4d-09173cf9fb3d tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-27fe0010-2e89-4647-852b-b7989ef25dd3-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[757882bb-f408-44a5-add1-80c6206bd183]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:06 devstack sudo[108997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208
Jun 24 04:28:06 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:07 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489" returned: 0 in 0.790s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:07 devstack sudo[109002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489
Jun 24 04:28:07 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:07 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208" returned: 0 in 0.797s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf298c7b-515b-4328-986d-c83b3768ac03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[66868efd-f513-4519-913b-d45db4eb1292]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:07 devstack sudo[109007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03
Jun 24 04:28:07 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:07 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489" returned: 0 in 0.639s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Lock "cinder-quobyte-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489" released by "delete_volume" :: held 1.474s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Created reservations ['fd446701-1666-420f-9c55-0f3de08ee95c', '22014974-aa32-4f8f-8791-3d12206478cf', 'a70d7b90-bfe3-4dd6-bc2c-71e03ac97ef0', '5e62d9e0-7254-4c27-8965-5bd14b7cb321'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:07 devstack sudo[109010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:07 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:08 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03" returned: 0 in 0.753s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:08 devstack sudo[109015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208
Jun 24 04:28:08 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:08 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.685s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:08 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Deleted volume successfully.
Jun 24 04:28:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-170af17e-d514-4253-a5ed-18cfe19e00c9 tempest-VolumesActionsTest-883201987 None] Lock "cinder-9f96c9ac-e35c-44e6-b2e0-fe10b2db6489-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:08 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (54d38435-5ff4-4932-a9a1-248ed8c2dff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b21494-24a3-4e42-914b-b539ed20fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b21494-24a3-4e42-914b-b539ed20fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-887833396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e4e414-f712-4877-a196-24c55b55a5fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:09Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62afb31b-8e35-4e59-a188-88f06dc8402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62afb31b-8e35-4e59-a188-88f06dc8402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3930defa-518c-4a67-927d-4c32a63cf4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3930defa-518c-4a67-927d-4c32a63cf4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e4e414-f712-4877-a196-24c55b55a5fa', 'volume_name': 'volume-57e4e414-f712-4877-a196-24c55b55a5fa', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf32bb6b-6553-44f2-865e-08425c994b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf32bb6b-6553-44f2-865e-08425c994b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12f56b0-5b5b-4b6d-b2ca-bb997f40a198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Volume 57e4e414-f712-4877-a196-24c55b55a5fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e4e414-f712-4877-a196-24c55b55a5fa', 'volume_size': 1}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-887833396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e4e414-f712-4877-a196-24c55b55a5fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab7820678c6402a9169643fc280b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:09Z,use_quota=True,user_id='c1f6cd52638c4b7f8712605f482d1206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Creating volume 57e4e414-f712-4877-a196-24c55b55a5fa {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:09 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:09 devstack sudo[109021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa 1073741824
Jun 24 04:28:09 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:09 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208" returned: 0 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:09 devstack sudo[109023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208
Jun 24 04:28:09 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:09 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03.7dbbd406-35f7-4121-b177-a0ccc8dd5208" returned: 0 in 0.664s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-7dbbd406-35f7-4121-b177-a0ccc8dd5208" released by "_delete_snapshot" :: held 3.076s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-cf298c7b-515b-4328-986d-c83b3768ac03" released by "delete_snapshot" :: held 3.104s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Created reservations ['1bdaaafb-1a18-4840-b03f-3b920fbe413f', 'e16f7873-178b-46df-8916-a17dc51dbc47', '9fc4d9aa-3077-4c72-b5d9-1b9c1c3fa574', '32303f27-ff5d-4c05-801a-8caeb2a9bc08'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:09 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa 1073741824" returned: 0 in 0.832s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:09 devstack sudo[109029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa
Jun 24 04:28:09 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Delete snapshot completed successfully.
Jun 24 04:28:09 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-43542e48-9512-4d80-a20b-59902eec1cdd tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-7dbbd406-35f7-4121-b177-a0ccc8dd5208-delete_snapshot" released by "delete_snapshot" :: held 3.290s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:10 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa" returned: 0 in 0.650s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12f56b0-5b5b-4b6d-b2ca-bb997f40a198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e4e414-f712-4877-a196-24c55b55a5fa', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ef7e29-58c3-43b9-b516-9a27b673640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:10 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Volume volume-57e4e414-f712-4877-a196-24c55b55a5fa (57e4e414-f712-4877-a196-24c55b55a5fa): created successfully
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ef7e29-58c3-43b9-b516-9a27b673640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Flow 'volume_create_manager' (54d38435-5ff4-4932-a9a1-248ed8c2dff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-52a04c24-8df0-46a7-be4a-6427a57d39ad tempest-VolumesActionsTest-1098181211 None] Created volume successfully.
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-cf298c7b-515b-4328-986d-c83b3768ac03-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-cf298c7b-515b-4328-986d-c83b3768ac03-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-cf298c7b-515b-4328-986d-c83b3768ac03" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-cf298c7b-515b-4328-986d-c83b3768ac03" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[486b720d-5e4b-4f58-b41c-52941f5dd286]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:11 devstack sudo[109032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03
Jun 24 04:28:11 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "cinder-57e4e414-f712-4877-a196-24c55b55a5fa-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-57e4e414-f712-4877-a196-24c55b55a5fa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "cinder-quobyte-57e4e414-f712-4877-a196-24c55b55a5fa" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-quobyte-57e4e414-f712-4877-a196-24c55b55a5fa" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5313ab-e818-4538-af80-ed335d754ce4]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:11 devstack sudo[109037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa
Jun 24 04:28:11 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:11 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03" returned: 0 in 0.823s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:11 devstack sudo[109040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03
Jun 24 04:28:11 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:12 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa" returned: 0 in 0.759s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:12 devstack sudo[109046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa
Jun 24 04:28:12 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:12 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cf298c7b-515b-4328-986d-c83b3768ac03" returned: 0 in 0.657s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-cf298c7b-515b-4328-986d-c83b3768ac03" released by "delete_volume" :: held 1.541s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Created reservations ['49b26d96-311a-458f-b5db-9b679bbacff8', '7c080ff7-c49a-4731-ac26-62a198cfbef3', 'b0c89eca-078d-4bec-a916-c26c8fcf8b73', 'fa709ec4-b4f4-4d99-9afb-faf3fed12113'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:12 devstack sudo[109048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:12 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:13 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57e4e414-f712-4877-a196-24c55b55a5fa" returned: 0 in 0.703s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-quobyte-57e4e414-f712-4877-a196-24c55b55a5fa" released by "delete_volume" :: held 1.510s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Created reservations ['2086f578-59af-43d9-8223-1fc26b08cb89', 'ae5b2e8e-ad14-44e6-823d-4ad220d1d7a4', '398a4fda-4795-44e7-aba9-e7d12eca65a4', '05c28398-d42d-4bdf-858b-0ff45f1e8b7c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:13 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.680s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:13 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Deleted volume successfully.
Jun 24 04:28:13 devstack sudo[109052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:13 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c9786780-762a-4745-993d-bbeceffb482c tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-cf298c7b-515b-4328-986d-c83b3768ac03-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (8f31e69a-eee7-4d2a-a481-075df31a12e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b6b077-1586-4bd3-b7d7-db7477dfb4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b6b077-1586-4bd3-b7d7-db7477dfb4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-129800208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355ed738-8dda-4648-bd3f-fd379ffbfd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376cd848de614b1fac3a7ff64d6a41fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:14Z,use_quota=True,user_id='6097361dd51b4f028c836719b385aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2baec124-5734-46ee-b3c6-abed985b14ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2baec124-5734-46ee-b3c6-abed985b14ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a97109-1808-4de2-bcec-18976c533232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a97109-1808-4de2-bcec-18976c533232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355ed738-8dda-4648-bd3f-fd379ffbfd40', 'volume_name': 'volume-355ed738-8dda-4648-bd3f-fd379ffbfd40', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf95c65-4a37-492d-908c-5ac9d53a9213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf95c65-4a37-492d-908c-5ac9d53a9213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacd58b5-5e4c-427b-aaad-5ef20844badd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume 355ed738-8dda-4648-bd3f-fd379ffbfd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355ed738-8dda-4648-bd3f-fd379ffbfd40', 'volume_size': 1}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-129800208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355ed738-8dda-4648-bd3f-fd379ffbfd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376cd848de614b1fac3a7ff64d6a41fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:14Z,use_quota=True,user_id='6097361dd51b4f028c836719b385aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Creating volume 355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:13 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:28:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:13 devstack sudo[109054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 1073741824
Jun 24 04:28:13 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:14 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.693s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:14 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Deleted volume successfully.
Jun 24 04:28:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3779d57c-19f2-42a1-9b76-96ef75abf526 tempest-VolumesActionsTest-1098181211 None] Lock "cinder-57e4e414-f712-4877-a196-24c55b55a5fa-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:14 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 1073741824" returned: 0 in 0.940s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:14 devstack sudo[109062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40
Jun 24 04:28:14 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:15 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40" returned: 0 in 0.670s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacd58b5-5e4c-427b-aaad-5ef20844badd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355ed738-8dda-4648-bd3f-fd379ffbfd40', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8374a6-b0dd-4027-80ff-481eed5d0dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:15 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 (355ed738-8dda-4648-bd3f-fd379ffbfd40): created successfully
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8374a6-b0dd-4027-80ff-481eed5d0dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (8f31e69a-eee7-4d2a-a481-075df31a12e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:15 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a5b960da-c355-4121-9ba5-e1eea7f5e8e8 tempest-VolumesSnapshotTestJSON-1098625906 None] Created volume successfully.
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:15 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=86,cinder:INSERT=26,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:28:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Creating offline snapshot e35f5636-b9d3-4d44-85dc-9505fcb1a25b of volume 355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc0389-ffc2-4af1-9898-c6845d078cf9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:16 devstack sudo[109066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40
Jun 24 04:28:16 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:16 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40" returned: 0 in 0.921s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:16 devstack sudo[109108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b 1G
Jun 24 04:28:16 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:17 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b 1G" returned: 0 in 0.857s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:17 devstack sudo[109114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b
Jun 24 04:28:17 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:18 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b" returned: 0 in 0.761s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:18 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b is being set with open permissions: ugo+rw
Jun 24 04:28:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:18 devstack sudo[109119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b
Jun 24 04:28:18 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:19 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b" returned: 0 in 0.698s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:19 devstack sudo[109123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.info
Jun 24 04:28:19 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:19 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.info" returned: 0 in 0.665s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:19 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.info is being set with open permissions: ugo+rw
Jun 24 04:28:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:20 devstack sudo[109126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.info
Jun 24 04:28:20 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:20 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.info" returned: 0 in 0.693s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.727s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:20 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-94ce4021-5fd8-4170-b19e-ef2a0a08806b tempest-VolumesSnapshotTestJSON-1098625906 None] Create snapshot completed successfully
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (710a6ec1-bf28-45a6-bb5b-62ff0808105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815243f7-fd00-49f2-b9fd-b7f35f12268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815243f7-fd00-49f2-b9fd-b7f35f12268b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-626575060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fcf10a-ab65-480d-8ae3-868f75a01040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376cd848de614b1fac3a7ff64d6a41fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e35f5636-b9d3-4d44-85dc-9505fcb1a25b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:22Z,use_quota=True,user_id='6097361dd51b4f028c836719b385aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13125c60-08a1-4f88-8471-81d1eaa2c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13125c60-08a1-4f88-8471-81d1eaa2c990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f4ca4d-3c44-40a5-a73d-4a5080d764c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f4ca4d-3c44-40a5-a73d-4a5080d764c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49fcf10a-ab65-480d-8ae3-868f75a01040', 'volume_name': 'volume-49fcf10a-ab65-480d-8ae3-868f75a01040', 'volume_size': 1, 'snapshot_id': 'e35f5636-b9d3-4d44-85dc-9505fcb1a25b'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc46556-e8f7-4fc1-9c99-3c1d917739ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc46556-e8f7-4fc1-9c99-3c1d917739ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3905d8fd-66f1-40b0-b6ea-d4ff673b1cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:21 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume 49fcf10a-ab65-480d-8ae3-868f75a01040: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49fcf10a-ab65-480d-8ae3-868f75a01040', 'volume_size': 1, 'snapshot_id': 'e35f5636-b9d3-4d44-85dc-9505fcb1a25b'}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-e35f5636-b9d3-4d44-85dc-9505fcb1a25b-49fcf10a-ab65-480d-8ae3-868f75a01040" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-e35f5636-b9d3-4d44-85dc-9505fcb1a25b-49fcf10a-ab65-480d-8ae3-868f75a01040" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Creating volume 49fcf10a-ab65-480d-8ae3-868f75a01040 from snapshot e35f5636-b9d3-4d44-85dc-9505fcb1a25b {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-49fcf10a-ab65-480d-8ae3-868f75a01040" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-49fcf10a-ab65-480d-8ae3-868f75a01040" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] snapshot: e35f5636-b9d3-4d44-85dc-9505fcb1a25b, volume: 49fcf10a-ab65-480d-8ae3-868f75a01040,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f568d9-a003-4a83-9410-516dd0ae5430]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:22 devstack sudo[109130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b
Jun 24 04:28:22 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:22 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b" returned: 0 in 0.872s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-355ed738-8dda-4648-bd3f-fd379ffbfd40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a12c0-f100-4825-a751-cc9316d2d03b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:23 devstack sudo[109135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40
Jun 24 04:28:23 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:23 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40" returned: 0 in 0.824s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:23 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040 not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:28:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:23 devstack sudo[109140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040
Jun 24 04:28:23 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:28 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040" returned: 0 in 5.207s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:28 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c039a545-0ae4-4278-9697-5c2807d42319]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:29 devstack sudo[109154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40
Jun 24 04:28:29 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:29 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40" returned: 0 in 0.987s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:29 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:28:29 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Converted 1024.00 MB image at 196.61 MB/s
Jun 24 04:28:29 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040 is being set with open permissions: ugo+rw
Jun 24 04:28:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:29 devstack sudo[109159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040
Jun 24 04:28:29 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:30 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040" returned: 0 in 0.673s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-49fcf10a-ab65-480d-8ae3-868f75a01040" released by "_copy_volume_from_snapshot" :: held 8.663s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:30 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-e35f5636-b9d3-4d44-85dc-9505fcb1a25b-49fcf10a-ab65-480d-8ae3-868f75a01040" released by "_create_volume_from_snapshot" :: held 8.699s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.718s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3905d8fd-66f1-40b0-b6ea-d4ff673b1cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fcf10a-ab65-480d-8ae3-868f75a01040', 'volume_size': 1, 'snapshot_id': 'e35f5636-b9d3-4d44-85dc-9505fcb1a25b'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b0355b-2c14-4da1-b5a8-6abe2ec25084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:30 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Volume volume-49fcf10a-ab65-480d-8ae3-868f75a01040 (49fcf10a-ab65-480d-8ae3-868f75a01040): created successfully
Jun 24 04:28:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b0355b-2c14-4da1-b5a8-6abe2ec25084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Flow 'volume_create_manager' (710a6ec1-bf28-45a6-bb5b-62ff0808105c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:30 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-aa4023fe-3ec3-40e3-b480-659b46e3ce16 tempest-VolumesSnapshotTestJSON-1098625906 None] Created volume successfully.
Jun 24 04:28:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-49fcf10a-ab65-480d-8ae3-868f75a01040-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-49fcf10a-ab65-480d-8ae3-868f75a01040-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-49fcf10a-ab65-480d-8ae3-868f75a01040" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:31 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-49fcf10a-ab65-480d-8ae3-868f75a01040" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:31 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2554f287-4ca6-4558-9d36-e8a4503094c2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:32 devstack sudo[109162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040
Jun 24 04:28:32 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Flow 'volume_create_manager' (5e238ad8-979f-45a5-8faa-74616cdbc802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df7f8c9-15f1-4cbf-9b4a-68dd0e3d6ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df7f8c9-15f1-4cbf-9b4a-68dd0e3d6ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-516950985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c6892d-fb61-4d58-bcb7-c3863988155a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be71a1d419f5409e81723e2feb3cf144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:32Z,use_quota=True,user_id='c80d479fa75f415d89c6fce86478538c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86511d3c-3eb1-4454-9d67-3a0c9aa83ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86511d3c-3eb1-4454-9d67-3a0c9aa83ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e5d2aa-ff3a-413c-9d5c-909758c35837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e5d2aa-ff3a-413c-9d5c-909758c35837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c6892d-fb61-4d58-bcb7-c3863988155a', 'volume_name': 'volume-44c6892d-fb61-4d58-bcb7-c3863988155a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1038e892-ee80-486a-9633-78b52b848b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1038e892-ee80-486a-9633-78b52b848b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624c533a-5aab-48e6-b417-73749f966257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:32 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Volume 44c6892d-fb61-4d58-bcb7-c3863988155a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c6892d-fb61-4d58-bcb7-c3863988155a', 'volume_size': 1}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-516950985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c6892d-fb61-4d58-bcb7-c3863988155a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be71a1d419f5409e81723e2feb3cf144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:32Z,use_quota=True,user_id='c80d479fa75f415d89c6fce86478538c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Creating volume 44c6892d-fb61-4d58-bcb7-c3863988155a {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:32 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:32 devstack sudo[109164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a 1073741824
Jun 24 04:28:32 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:32 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040" returned: 0 in 0.774s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:32 devstack sudo[109169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040
Jun 24 04:28:32 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:33 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a 1073741824" returned: 0 in 0.846s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:33 devstack sudo[109174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a
Jun 24 04:28:33 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:33 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-49fcf10a-ab65-480d-8ae3-868f75a01040" returned: 0 in 0.658s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-49fcf10a-ab65-480d-8ae3-868f75a01040" released by "delete_volume" :: held 1.481s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Created reservations ['626c2673-91dc-40d1-98ff-83b6e7ed1cdc', 'df8d9ee8-b2e9-4c93-9f3d-07259e592fb0', '6ebbc64c-9e57-4007-826f-2f506bbe3d07', '32541f16-7762-43ec-ae00-b7af95a271fc'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:33 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:33 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:33 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a" returned: 0 in 0.628s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624c533a-5aab-48e6-b417-73749f966257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c6892d-fb61-4d58-bcb7-c3863988155a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e98246a8-2cab-4dca-9c10-4aadda75b5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:33 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Volume volume-44c6892d-fb61-4d58-bcb7-c3863988155a (44c6892d-fb61-4d58-bcb7-c3863988155a): created successfully
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e98246a8-2cab-4dca-9c10-4aadda75b5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:33 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Flow 'volume_create_manager' (5e238ad8-979f-45a5-8faa-74616cdbc802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fdecb3ac-b942-40ec-9705-e5f98a97b71c tempest-SnapshotMetadataTestJSON-1221603336 None] Created volume successfully.
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-e35f5636-b9d3-4d44-85dc-9505fcb1a25b-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-e35f5636-b9d3-4d44-85dc-9505fcb1a25b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-355ed738-8dda-4648-bd3f-fd379ffbfd40" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-355ed738-8dda-4648-bd3f-fd379ffbfd40" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-e35f5636-b9d3-4d44-85dc-9505fcb1a25b" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-e35f5636-b9d3-4d44-85dc-9505fcb1a25b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Deleting offline snapshot e35f5636-b9d3-4d44-85dc-9505fcb1a25b of volume 355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:28:34 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] snapshot_file for this snap is: volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:34 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Deleted volume successfully.
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eed12c-021b-43b4-839d-36617cae4c47]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e4317b41-7483-4f99-8f88-51486c84989e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-49fcf10a-ab65-480d-8ae3-868f75a01040-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:34 devstack sudo[109181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b
Jun 24 04:28:34 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Creating offline snapshot bdd7ce89-1c20-4129-b80c-b29cfafd2684 of volume 44c6892d-fb61-4d58-bcb7-c3863988155a {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[64279508-d635-41cc-bab9-63b55d289f78]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:34 devstack sudo[109183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a
Jun 24 04:28:34 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:35 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b" returned: 0 in 0.771s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-355ed738-8dda-4648-bd3f-fd379ffbfd40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:35 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[85029f63-666c-4680-9c74-3e9654648030]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:35 devstack sudo[109189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40
Jun 24 04:28:35 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:35 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a" returned: 0 in 0.777s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:35 devstack sudo[109193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 1G
Jun 24 04:28:35 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:35 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40" returned: 0 in 0.759s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:35 devstack sudo[109201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b
Jun 24 04:28:35 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:36 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 1G" returned: 0 in 0.829s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c6892d-fb61-4d58-bcb7-c3863988155a -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:36 devstack sudo[109203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c6892d-fb61-4d58-bcb7-c3863988155a -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684
Jun 24 04:28:36 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:36 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b" returned: 0 in 0.791s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:36 devstack sudo[109209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b
Jun 24 04:28:36 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:36 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c6892d-fb61-4d58-bcb7-c3863988155a -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684" returned: 0 in 0.712s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:36 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 is being set with open permissions: ugo+rw
Jun 24 04:28:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:36 devstack sudo[109214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684
Jun 24 04:28:36 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:37 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40.e35f5636-b9d3-4d44-85dc-9505fcb1a25b" returned: 0 in 0.628s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-e35f5636-b9d3-4d44-85dc-9505fcb1a25b" released by "_delete_snapshot" :: held 3.078s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-355ed738-8dda-4648-bd3f-fd379ffbfd40" released by "delete_snapshot" :: held 3.110s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:37 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Created reservations ['f9a70b9f-379a-4b51-b291-7374ab64eb2f', '427a3251-cef3-4173-9d8c-d098e3569882', 'fbcf14b0-af17-487c-a9c3-946388f5d0bc', '5e6c6735-15e9-4dd5-947f-c605ebc75ccc'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:37 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Delete snapshot completed successfully.
Jun 24 04:28:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d4e3d9c0-e53a-49f3-b924-75dcad4741d9 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-e35f5636-b9d3-4d44-85dc-9505fcb1a25b-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:37 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684" returned: 0 in 0.657s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:37 devstack sudo[109218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.info
Jun 24 04:28:37 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:38 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.info" returned: 0 in 0.642s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:38 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.info is being set with open permissions: ugo+rw
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:38 devstack sudo[109221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.info
Jun 24 04:28:38 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-355ed738-8dda-4648-bd3f-fd379ffbfd40-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-355ed738-8dda-4648-bd3f-fd379ffbfd40-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-355ed738-8dda-4648-bd3f-fd379ffbfd40" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-355ed738-8dda-4648-bd3f-fd379ffbfd40" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30cd5d3-cc1d-433c-9381-d84c3a05115f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:38 devstack sudo[109223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40
Jun 24 04:28:38 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:38 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.info" returned: 0 in 0.638s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.372s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:38 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-85930d40-ce4a-49ca-8024-f8e3bcd9ac18 tempest-SnapshotMetadataTestJSON-1221603336 None] Create snapshot completed successfully
Jun 24 04:28:39 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40" returned: 0 in 0.787s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:39 devstack sudo[109229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40
Jun 24 04:28:39 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:40 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-355ed738-8dda-4648-bd3f-fd379ffbfd40" returned: 0 in 0.636s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-355ed738-8dda-4648-bd3f-fd379ffbfd40" released by "delete_volume" :: held 1.475s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Created reservations ['803d1bee-5b7c-49f0-9563-fbd3c501c449', 'e02803b0-ce8f-4ad8-bcfa-9f8086aaf521', 'b18753d5-4eec-4666-986f-b67f8871400b', '79685cda-0407-4a00-b236-a8b943d6437f'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:40 devstack sudo[109232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:40 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "cinder-bdd7ce89-1c20-4129-b80c-b29cfafd2684-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-bdd7ce89-1c20-4129-b80c-b29cfafd2684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "cinder-quobyte-44c6892d-fb61-4d58-bcb7-c3863988155a" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-quobyte-44c6892d-fb61-4d58-bcb7-c3863988155a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "cinder-quobyte-bdd7ce89-1c20-4129-b80c-b29cfafd2684" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-quobyte-bdd7ce89-1c20-4129-b80c-b29cfafd2684" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Deleting offline snapshot bdd7ce89-1c20-4129-b80c-b29cfafd2684 of volume 44c6892d-fb61-4d58-bcb7-c3863988155a {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] snapshot_file for this snap is: volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[075c451e-42a3-48db-8c87-6d4de96ce740]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:40 devstack sudo[109234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684
Jun 24 04:28:40 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-b43ef697-f112-4406-a344-3f3b318ad718-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-b43ef697-f112-4406-a344-3f3b318ad718-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "cinder-quobyte-b43ef697-f112-4406-a344-3f3b318ad718" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:40 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-b43ef697-f112-4406-a344-3f3b318ad718" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Deleted volume successfully.
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[04781be6-8a59-45b4-8e8e-103039c11f58]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-8eaa9988-7ce8-4327-bc69-143a9037875e tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-355ed738-8dda-4648-bd3f-fd379ffbfd40-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:41 devstack sudo[109237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718
Jun 24 04:28:41 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:41 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684" returned: 0 in 0.786s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44c6892d-fb61-4d58-bcb7-c3863988155a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:41 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4212fd-28e7-44eb-bb52-b7700513550a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:41 devstack sudo[109242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a
Jun 24 04:28:41 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:41 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718" returned: 0 in 0.783s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:41 devstack sudo[109247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718
Jun 24 04:28:41 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:42 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a" returned: 0 in 0.786s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:42 devstack sudo[109252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684
Jun 24 04:28:42 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:42 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-b43ef697-f112-4406-a344-3f3b318ad718" returned: 0 in 0.639s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-quobyte-b43ef697-f112-4406-a344-3f3b318ad718" released by "delete_volume" :: held 1.496s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Created reservations ['3d8f44c0-3f9b-4999-87bc-7954f847da4e', 'dbf9e9d2-a60c-48ce-8339-23911e15c37a', '5f3b58d6-c3ca-48b5-8b3b-eda0ad93b8b1', '058ca92b-eea2-4eed-b749-b1c7b51a294c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:42 devstack sudo[109255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:42 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:42 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684" returned: 0 in 0.748s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:42 devstack sudo[109260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684
Jun 24 04:28:42 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:43 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.670s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:43 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Deleted volume successfully.
Jun 24 04:28:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a1c65fe-be58-4340-b1e7-9d82f5a4d732 tempest-VolumesSnapshotTestJSON-1098625906 None] Lock "cinder-b43ef697-f112-4406-a344-3f3b318ad718-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:43 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a.bdd7ce89-1c20-4129-b80c-b29cfafd2684" returned: 0 in 0.673s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-quobyte-bdd7ce89-1c20-4129-b80c-b29cfafd2684" released by "_delete_snapshot" :: held 3.107s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-quobyte-44c6892d-fb61-4d58-bcb7-c3863988155a" released by "delete_snapshot" :: held 3.130s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:43 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Created reservations ['6daa9640-3a2a-49ba-8fcb-dd1624d9fb69', 'f20e17ca-f2ab-424c-aeeb-0ce111e269ab', 'fcb5dd65-a7fc-493a-b393-0644a986bf56', 'f0454d8d-aafc-4504-bbed-b7afd1fb2de0'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Delete snapshot completed successfully.
Jun 24 04:28:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-32ee4c6a-6e64-48a1-8e57-e43b7ae57a99 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-bdd7ce89-1c20-4129-b80c-b29cfafd2684-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "cinder-44c6892d-fb61-4d58-bcb7-c3863988155a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-44c6892d-fb61-4d58-bcb7-c3863988155a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "cinder-quobyte-44c6892d-fb61-4d58-bcb7-c3863988155a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-quobyte-44c6892d-fb61-4d58-bcb7-c3863988155a" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:44 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[47826cbb-84af-42dd-ab6d-ef83996152d1]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:44 devstack sudo[109265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a
Jun 24 04:28:44 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:45 devstack sudo[109267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:45 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:45 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a" returned: 0 in 0.819s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:45 devstack sudo[109272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a
Jun 24 04:28:45 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:46 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.783s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:28:46 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-44c6892d-fb61-4d58-bcb7-c3863988155a" returned: 0 in 0.784s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-quobyte-44c6892d-fb61-4d58-bcb7-c3863988155a" released by "delete_volume" :: held 1.676s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Created reservations ['da89aad6-9ad1-442f-abca-b286086b4d57', '2a88f654-9d7d-471f-8ef7-104b27de190f', 'c7081995-bef0-43a7-9bcc-c13a7dd36f64', '65d1d0f6-3827-4c88-8f6d-0a30495f25db'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:46 devstack sudo[109278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:46 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:47 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.729s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:47 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:47 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Deleted volume successfully.
Jun 24 04:28:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-eb406991-f337-40d1-b2fe-5b7a4f7d6b67 tempest-SnapshotMetadataTestJSON-1221603336 None] Lock "cinder-44c6892d-fb61-4d58-bcb7-c3863988155a-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Flow 'volume_create_manager' (55b052ef-7e2e-46ac-b7a4-4ac379102691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf59813d-09f0-4a0d-a692-4964a6a400f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf59813d-09f0-4a0d-a692-4964a6a400f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-320856682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb788cf7-ebba-4616-921a-97dd24f5cc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03ecb265242b4c1f84aac46fe33c8e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:49Z,use_quota=True,user_id='62e0aa638a93421f91d01ad3023e98ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaaf2ec-4b88-4587-a761-0dc1bd406e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaaf2ec-4b88-4587-a761-0dc1bd406e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7054928-8c77-437e-84df-8433cf95a36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7054928-8c77-437e-84df-8433cf95a36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb788cf7-ebba-4616-921a-97dd24f5cc02', 'volume_name': 'volume-fb788cf7-ebba-4616-921a-97dd24f5cc02', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812475cf-f6ac-4cfa-a44a-b451e6e3cf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812475cf-f6ac-4cfa-a44a-b451e6e3cf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7aef0f2-2be4-4b69-893f-6ce76fbfab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Volume fb788cf7-ebba-4616-921a-97dd24f5cc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb788cf7-ebba-4616-921a-97dd24f5cc02', 'volume_size': 1}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-320856682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb788cf7-ebba-4616-921a-97dd24f5cc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03ecb265242b4c1f84aac46fe33c8e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:49Z,use_quota=True,user_id='62e0aa638a93421f91d01ad3023e98ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Creating volume fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:49 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:28:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:49 devstack sudo[109281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 1073741824
Jun 24 04:28:49 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Flow 'volume_create_manager' (85ed0bb9-4e8e-4ae6-ba84-03dd7ae9cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea56bfee-8581-45b8-a8a5-f4d45fa3b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea56bfee-8581-45b8-a8a5-f4d45fa3b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1792562744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf9a14b-913b-4928-b553-42a68f4c0860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ae864c45cf4f3b8c444b699bf8dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:50Z,use_quota=True,user_id='978fb3dd12054e5583c256b31840eec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6658e58f-1252-41f6-806c-0e4d015225fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6658e58f-1252-41f6-806c-0e4d015225fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaab23cf-18c5-4606-a54e-cd5f459e088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaab23cf-18c5-4606-a54e-cd5f459e088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf9a14b-913b-4928-b553-42a68f4c0860', 'volume_name': 'volume-bcf9a14b-913b-4928-b553-42a68f4c0860', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e410fe-c1e4-4f6a-a72b-d9d5e58bdd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e410fe-c1e4-4f6a-a72b-d9d5e58bdd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245999b6-fcdd-4f6e-a8ca-14d281499a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:50 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Volume bcf9a14b-913b-4928-b553-42a68f4c0860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf9a14b-913b-4928-b553-42a68f4c0860', 'volume_size': 1}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:50 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 1073741824" returned: 0 in 0.866s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:50 devstack sudo[109287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02
Jun 24 04:28:50 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:50 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02" returned: 0 in 0.637s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1792562744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf9a14b-913b-4928-b553-42a68f4c0860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ae864c45cf4f3b8c444b699bf8dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:50Z,use_quota=True,user_id='978fb3dd12054e5583c256b31840eec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Creating volume bcf9a14b-913b-4928-b553-42a68f4c0860 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:50 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7aef0f2-2be4-4b69-893f-6ce76fbfab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb788cf7-ebba-4616-921a-97dd24f5cc02', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a47be0-f009-407b-b1bb-b42ab5ccf540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:50 devstack sudo[109290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860 1073741824
Jun 24 04:28:50 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:50 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Volume volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 (fb788cf7-ebba-4616-921a-97dd24f5cc02): created successfully
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a47be0-f009-407b-b1bb-b42ab5ccf540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Flow 'volume_create_manager' (55b052ef-7e2e-46ac-b7a4-4ac379102691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:50 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-36140ede-fb6d-49fa-bd01-8d2e7786d58f tempest-VolumesSnapshotListTestJSON-493795403 None] Created volume successfully.
Jun 24 04:28:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:51 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860 1073741824" returned: 0 in 0.842s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:51 devstack sudo[109295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860
Jun 24 04:28:51 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:52 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860" returned: 0 in 0.638s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.926s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245999b6-fcdd-4f6e-a8ca-14d281499a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf9a14b-913b-4928-b553-42a68f4c0860', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd4fdc6-29f9-49eb-a5b3-7f97de043498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Creating offline snapshot b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 of volume fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:52 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Volume volume-bcf9a14b-913b-4928-b553-42a68f4c0860 (bcf9a14b-913b-4928-b553-42a68f4c0860): created successfully
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd4fdc6-29f9-49eb-a5b3-7f97de043498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Flow 'volume_create_manager' (85ed0bb9-4e8e-4ae6-ba84-03dd7ae9cc97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d2bae6-6f77-47af-98cd-1889bf1f996d]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-89e225df-24da-4aef-b4bb-81c0ae69b327 tempest-VolumesMetadataTest-936723304 None] Created volume successfully.
Jun 24 04:28:52 devstack sudo[109298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02
Jun 24 04:28:52 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:53 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02" returned: 0 in 0.769s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:53 devstack sudo[109304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 1G
Jun 24 04:28:53 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Acquiring lock "cinder-bcf9a14b-913b-4928-b553-42a68f4c0860-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Lock "cinder-bcf9a14b-913b-4928-b553-42a68f4c0860-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Acquiring lock "cinder-quobyte-bcf9a14b-913b-4928-b553-42a68f4c0860" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Lock "cinder-quobyte-bcf9a14b-913b-4928-b553-42a68f4c0860" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[654248ee-1ea9-4ebc-bbcb-101b72d4bf11]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:54 devstack sudo[109309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860
Jun 24 04:28:54 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:54 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 1G" returned: 0 in 0.845s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:54 devstack sudo[109311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133
Jun 24 04:28:54 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:54 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860" returned: 0 in 0.763s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:54 devstack sudo[109319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860
Jun 24 04:28:54 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:54 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" returned: 0 in 0.703s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:54 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 is being set with open permissions: ugo+rw
Jun 24 04:28:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:54 devstack sudo[109321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133
Jun 24 04:28:54 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:55 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bcf9a14b-913b-4928-b553-42a68f4c0860" returned: 0 in 0.657s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Lock "cinder-quobyte-bcf9a14b-913b-4928-b553-42a68f4c0860" released by "delete_volume" :: held 1.460s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:55 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" returned: 0 in 0.640s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Created reservations ['e5220e6c-0fae-4013-9149-14a94a418933', '008627b5-6e79-4a73-a397-17b5189e8311', '44d52b0d-4798-4a70-b097-52468055229e', '27d8aa81-d6ca-4bbc-ab07-eff811b247e1'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:55 devstack sudo[109331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.info
Jun 24 04:28:55 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:55 devstack sudo[109333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:28:55 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:56 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.info" returned: 0 in 0.705s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:56 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.info is being set with open permissions: ugo+rw
Jun 24 04:28:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:56 devstack sudo[109338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.info
Jun 24 04:28:56 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:56 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.687s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:56 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Deleted volume successfully.
Jun 24 04:28:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-9a0bcb48-6779-4faf-9c62-626f0aa96b30 tempest-VolumesMetadataTest-936723304 None] Lock "cinder-bcf9a14b-913b-4928-b553-42a68f4c0860-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:56 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.info" returned: 0 in 0.712s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.495s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d5d56a32-bc16-4d4b-950f-966f002420d0 tempest-VolumesSnapshotListTestJSON-493795403 None] Create snapshot completed successfully
Jun 24 04:28:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Creating offline snapshot 9f198196-401c-4949-9753-f43b4b94f985 of volume fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:57 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d7f2ee-7d97-4d7c-a920-b733b7db0865]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:58 devstack sudo[109341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133
Jun 24 04:28:58 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:58 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" returned: 0 in 0.810s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb788cf7-ebba-4616-921a-97dd24f5cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:58 devstack sudo[109346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 1G
Jun 24 04:28:58 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:59 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 1G" returned: 0 in 0.899s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:59 devstack sudo[109352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985
Jun 24 04:28:59 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:00 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985" returned: 0 in 0.746s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:00 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 is being set with open permissions: ugo+rw
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:00 devstack sudo[109357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985
Jun 24 04:29:00 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Flow 'volume_create_manager' (e23936ce-4ab3-44e0-aa25-b4b843cee285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcdd9b3-0105-42a5-8818-5cf662723482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcdd9b3-0105-42a5-8818-5cf662723482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1108774493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4aa17b-f504-421d-8322-54d17955b3cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea1722a790148e1a53fbbf19d2239a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:00Z,use_quota=True,user_id='c40327a9b52345b491b88e68f311d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41588441-f31a-42f9-ad49-fccaaf2665ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41588441-f31a-42f9-ad49-fccaaf2665ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62688899-5f35-4815-99b1-bee4b154d368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62688899-5f35-4815-99b1-bee4b154d368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4aa17b-f504-421d-8322-54d17955b3cb', 'volume_name': 'volume-9c4aa17b-f504-421d-8322-54d17955b3cb', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4292d7-3a89-46dd-8572-cf462f7382c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4292d7-3a89-46dd-8572-cf462f7382c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e0ca72-6920-4470-afe2-7ee5bfc10c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:00 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Volume 9c4aa17b-f504-421d-8322-54d17955b3cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4aa17b-f504-421d-8322-54d17955b3cb', 'volume_size': 1}
Jun 24 04:29:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:01 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985" returned: 0 in 0.649s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.204s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1108774493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4aa17b-f504-421d-8322-54d17955b3cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea1722a790148e1a53fbbf19d2239a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:00Z,use_quota=True,user_id='c40327a9b52345b491b88e68f311d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Creating volume 9c4aa17b-f504-421d-8322-54d17955b3cb {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:01 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:01 devstack sudo[109361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb 1073741824
Jun 24 04:29:01 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fef4a91d-cca1-4cc6-90a0-017820b8a9db tempest-VolumesSnapshotListTestJSON-493795403 None] Create snapshot completed successfully
Jun 24 04:29:01 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb 1073741824" returned: 0 in 0.857s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:02 devstack sudo[109366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb
Jun 24 04:29:02 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:02 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb" returned: 0 in 0.698s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.421s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Creating offline snapshot ae3d63a9-b958-4ee0-8896-529dfdd3566c of volume fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e0ca72-6920-4470-afe2-7ee5bfc10c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4aa17b-f504-421d-8322-54d17955b3cb', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d238d9b4-1807-4007-9c1f-e4fb48a207d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c81c91c-080b-466e-943d-ff8972d735fd]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:02 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Volume volume-9c4aa17b-f504-421d-8322-54d17955b3cb (9c4aa17b-f504-421d-8322-54d17955b3cb): created successfully
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d238d9b4-1807-4007-9c1f-e4fb48a207d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Flow 'volume_create_manager' (e23936ce-4ab3-44e0-aa25-b4b843cee285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:02 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8e8630dc-af63-4a1a-b80f-7ac2d9feae1d tempest-VolumesTransfersV357Test-744596847 None] Created volume successfully.
Jun 24 04:29:02 devstack sudo[109370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985
Jun 24 04:29:02 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:03 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985" returned: 0 in 0.782s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb788cf7-ebba-4616-921a-97dd24f5cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:03 devstack sudo[109375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c 1G
Jun 24 04:29:03 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c4ed4376-23c6-425e-a5bc-5eb5422d7e9f tempest-VolumesTransfersV357Test-782526702 None] Transfer volume completed successfully.
Jun 24 04:29:04 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c 1G" returned: 0 in 0.889s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:04 devstack sudo[109381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c
Jun 24 04:29:04 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Acquiring lock "cinder-9c4aa17b-f504-421d-8322-54d17955b3cb-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Lock "cinder-9c4aa17b-f504-421d-8322-54d17955b3cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Acquiring lock "cinder-quobyte-9c4aa17b-f504-421d-8322-54d17955b3cb" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Lock "cinder-quobyte-9c4aa17b-f504-421d-8322-54d17955b3cb" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c8200-fa06-4093-b1fa-d449cb56f1cf]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:05 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c" returned: 0 in 0.716s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:05 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c is being set with open permissions: ugo+rw
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:05 devstack sudo[109387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c
Jun 24 04:29:05 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:05 devstack sudo[109386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb
Jun 24 04:29:05 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:05 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c" returned: 0 in 0.634s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.127s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:05 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-cd4ff2d1-d91c-4ea3-8a26-252b9f53b772 tempest-VolumesSnapshotListTestJSON-493795403 None] Create snapshot completed successfully
Jun 24 04:29:05 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb" returned: 0 in 0.753s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:05 devstack sudo[109396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb
Jun 24 04:29:05 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:06 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9c4aa17b-f504-421d-8322-54d17955b3cb" returned: 0 in 0.676s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Lock "cinder-quobyte-9c4aa17b-f504-421d-8322-54d17955b3cb" released by "delete_volume" :: held 1.472s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Created reservations ['2f76e084-8c14-4e0f-9d66-a9a7e304c161', '905cd7d1-2313-4582-825f-fcb93935aecd', '6c4cf936-9740-458e-8b36-b6a4a37b830a', 'ec125b94-f1bb-4d2b-a271-ddaee6a49e18'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:06 devstack sudo[109400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:29:06 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-ae3d63a9-b958-4ee0-8896-529dfdd3566c-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-ae3d63a9-b958-4ee0-8896-529dfdd3566c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-quobyte-ae3d63a9-b958-4ee0-8896-529dfdd3566c" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-ae3d63a9-b958-4ee0-8896-529dfdd3566c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Deleting offline snapshot ae3d63a9-b958-4ee0-8896-529dfdd3566c of volume fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] snapshot_file for this snap is: volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:29:07 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.672s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:07 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Deleted volume successfully.
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=86,cinder:INSERT=32,cinder:UPDATE=117,cinder:DELETE=11 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd70bcf-a8bb-4a7c-b8cc-7e9013065ed5]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-833a78cf-c1f7-4357-9f03-dc0697bc0168 tempest-VolumesTransfersV357Test-561413373 None] Lock "cinder-9c4aa17b-f504-421d-8322-54d17955b3cb-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:07 devstack sudo[109403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c
Jun 24 04:29:07 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Flow 'volume_create_manager' (9950e54c-79fa-4424-ba77-3f4f326e0c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac04b10-b549-4776-bc23-5bb28b909cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac04b10-b549-4776-bc23-5bb28b909cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-31969419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca7995c-07ec-4f72-8cb8-8463d3bb967d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea1722a790148e1a53fbbf19d2239a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:08Z,use_quota=True,user_id='c40327a9b52345b491b88e68f311d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa06fc9a-f374-447c-a5b7-f751c245187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa06fc9a-f374-447c-a5b7-f751c245187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc27e827-0fd8-4c4e-8b94-8d0981fa0d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc27e827-0fd8-4c4e-8b94-8d0981fa0d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca7995c-07ec-4f72-8cb8-8463d3bb967d', 'volume_name': 'volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7cf3b9-b445-4056-b30e-ab28e2fb4d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7cf3b9-b445-4056-b30e-ab28e2fb4d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf48262-e20c-42af-b246-6b541eecbd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:07 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Volume 9ca7995c-07ec-4f72-8cb8-8463d3bb967d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d', 'volume_size': 1}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-31969419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca7995c-07ec-4f72-8cb8-8463d3bb967d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea1722a790148e1a53fbbf19d2239a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:08Z,use_quota=True,user_id='c40327a9b52345b491b88e68f311d4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Creating volume 9ca7995c-07ec-4f72-8cb8-8463d3bb967d {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:07 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:29:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:07 devstack sudo[109405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d 1073741824
Jun 24 04:29:07 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:08 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c" returned: 0 in 0.791s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb788cf7-ebba-4616-921a-97dd24f5cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eb9ffb-0c19-453b-b1f0-05919b7c4cd4]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:08 devstack sudo[109410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985
Jun 24 04:29:08 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:08 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d 1073741824" returned: 0 in 0.820s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:08 devstack sudo[109415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d
Jun 24 04:29:08 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:08 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985" returned: 0 in 0.780s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb788cf7-ebba-4616-921a-97dd24f5cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:09 devstack sudo[109420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c
Jun 24 04:29:09 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:09 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d" returned: 0 in 0.628s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf48262-e20c-42af-b246-6b541eecbd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6abe53-cb39-40ae-beef-07defe3d2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:09 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Volume volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d (9ca7995c-07ec-4f72-8cb8-8463d3bb967d): created successfully
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6abe53-cb39-40ae-beef-07defe3d2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Flow 'volume_create_manager' (9950e54c-79fa-4424-ba77-3f4f326e0c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:09 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e9356ff1-0ae2-4fa2-8268-f0c4f03683a4 tempest-VolumesTransfersV357Test-744596847 None] Created volume successfully.
Jun 24 04:29:09 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c" returned: 0 in 0.779s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:09 devstack sudo[109427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c
Jun 24 04:29:09 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Acquiring lock "cinder-9ca7995c-07ec-4f72-8cb8-8463d3bb967d-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Lock "cinder-9ca7995c-07ec-4f72-8cb8-8463d3bb967d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Acquiring lock "cinder-quobyte-9ca7995c-07ec-4f72-8cb8-8463d3bb967d" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Lock "cinder-quobyte-9ca7995c-07ec-4f72-8cb8-8463d3bb967d" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89df7dd-799b-4f0e-b94a-4bd54c627c42]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:10 devstack sudo[109429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d
Jun 24 04:29:10 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:10 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.ae3d63a9-b958-4ee0-8896-529dfdd3566c" returned: 0 in 0.652s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-ae3d63a9-b958-4ee0-8896-529dfdd3566c" released by "_delete_snapshot" :: held 3.117s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" released by "delete_snapshot" :: held 3.138s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Created reservations ['ebbb8452-ef23-4acd-9192-08687f8f1661', '93915e8d-4839-4c18-9e0b-1bb384048dcd', '30842aec-716b-4b4f-98c9-9369f60fc0b2', 'f5a1667e-79a1-43df-b206-1a0e8548bb98'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Delete snapshot completed successfully.
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2543d19e-337f-4925-b088-978db0b4a732 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-ae3d63a9-b958-4ee0-8896-529dfdd3566c-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:10 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d" returned: 0 in 0.762s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:11 devstack sudo[109435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d
Jun 24 04:29:11 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-9f198196-401c-4949-9753-f43b4b94f985-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-9f198196-401c-4949-9753-f43b4b94f985-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-quobyte-9f198196-401c-4949-9753-f43b4b94f985" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-9f198196-401c-4949-9753-f43b4b94f985" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Deleting offline snapshot 9f198196-401c-4949-9753-f43b4b94f985 of volume fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] snapshot_file for this snap is: volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c74bc1-2526-4cc4-aca3-a58906311fe4]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:11 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9ca7995c-07ec-4f72-8cb8-8463d3bb967d" returned: 0 in 0.643s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Lock "cinder-quobyte-9ca7995c-07ec-4f72-8cb8-8463d3bb967d" released by "delete_volume" :: held 1.444s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:11 devstack sudo[109439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985
Jun 24 04:29:11 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Created reservations ['3e176c30-8b4c-4283-b918-f3123e728ff7', 'caf0ea19-9de3-4ea9-be52-1ebf6cc5d20e', 'cf42dabf-88c7-4514-9403-40bcefa75a2e', 'cb92b5e9-05b9-4efd-be34-8b6f6d75361b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:11 devstack sudo[109441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:29:11 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:12 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985" returned: 0 in 0.754s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:12 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb788cf7-ebba-4616-921a-97dd24f5cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:12 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead1b4b7-5021-442f-93b7-fcd06d6f20fd]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:12 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.686s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:12 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:12 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Deleted volume successfully.
Jun 24 04:29:12 devstack sudo[109447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133
Jun 24 04:29:12 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:12 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4f12f3d6-bccc-4412-91ec-9007539ca42c tempest-VolumesTransfersV357Test-561413373 None] Lock "cinder-9ca7995c-07ec-4f72-8cb8-8463d3bb967d-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:13 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" returned: 0 in 0.769s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb788cf7-ebba-4616-921a-97dd24f5cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:13 devstack sudo[109452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985
Jun 24 04:29:13 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:13 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985" returned: 0 in 0.829s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:14 devstack sudo[109458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985
Jun 24 04:29:14 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:14 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.9f198196-401c-4949-9753-f43b4b94f985" returned: 0 in 0.711s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-9f198196-401c-4949-9753-f43b4b94f985" released by "_delete_snapshot" :: held 3.181s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" released by "delete_snapshot" :: held 3.203s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:14 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Created reservations ['d2af0559-51cb-41ea-b2f9-101223272641', '591b3d13-56f2-406a-8ed9-2828a1a164eb', '82e0b317-c28d-4959-8bf7-68be26b1abbf', '3aa5dc8b-da52-461f-8722-4f6a7702d49c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Delete snapshot completed successfully.
Jun 24 04:29:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1814c30d-8e73-4c2c-b53e-38e7a8541c86 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-9f198196-401c-4949-9753-f43b4b94f985-delete_snapshot" released by "delete_snapshot" :: held 3.388s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-quobyte-b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Deleting offline snapshot b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 of volume fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] snapshot_file for this snap is: volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[851cd5a3-1f73-4f9a-8d1b-ecf52f2f21b8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:15 devstack sudo[109462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133
Jun 24 04:29:15 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:16 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" returned: 0 in 0.798s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb788cf7-ebba-4616-921a-97dd24f5cc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[596ea449-202c-40b7-996a-4290d3aba310]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:16 devstack sudo[109468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02
Jun 24 04:29:16 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:17 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02" returned: 0 in 0.792s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:17 devstack sudo[109509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133
Jun 24 04:29:17 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=89,cinder:UPDATE=98,cinder:INSERT=19,cinder:DELETE=10 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Flow 'volume_create_manager' (b18169f2-a685-4e8f-b24e-a8cc999c858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90e54a3-c5d1-4095-84d1-aedd2269b902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90e54a3-c5d1-4095-84d1-aedd2269b902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1098659230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a55142-9904-4cb4-8d96-e8604f6532bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf09378134c1402a9dfa5aa309743494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:18Z,use_quota=True,user_id='4eef284699bd474cbd110fe9da0745fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e39f45b-ad00-47a0-93b6-091f8b28c1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e39f45b-ad00-47a0-93b6-091f8b28c1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85de7880-20dc-4354-a14c-81ae87072f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85de7880-20dc-4354-a14c-81ae87072f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a55142-9904-4cb4-8d96-e8604f6532bf', 'volume_name': 'volume-c3a55142-9904-4cb4-8d96-e8604f6532bf', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0eda22-0d84-4c6d-bd22-7c03da953871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0eda22-0d84-4c6d-bd22-7c03da953871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08d1afb-afdc-487f-94f7-eb0c43dc6240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Volume c3a55142-9904-4cb4-8d96-e8604f6532bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a55142-9904-4cb4-8d96-e8604f6532bf', 'volume_size': 1}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1098659230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a55142-9904-4cb4-8d96-e8604f6532bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf09378134c1402a9dfa5aa309743494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:18Z,use_quota=True,user_id='4eef284699bd474cbd110fe9da0745fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Creating volume c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:17 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:29:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:17 devstack sudo[109511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf 1073741824
Jun 24 04:29:17 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:18 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" returned: 0 in 0.751s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:18 devstack sudo[109516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133
Jun 24 04:29:18 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:18 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf 1073741824" returned: 0 in 0.818s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:18 devstack sudo[109522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf
Jun 24 04:29:18 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:18 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02.b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" returned: 0 in 0.652s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133" released by "_delete_snapshot" :: held 3.106s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" released by "delete_snapshot" :: held 3.128s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Created reservations ['bfcc7ace-ffa2-4dbc-982f-bf65442b9d40', 'a8f97a0d-8088-44b4-a740-7619e587e105', '5b504540-37f1-4ac4-ad8a-f5ea089e2810', '9ead3a75-3d7d-492f-b7e2-82c74c855ada'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:18 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Delete snapshot completed successfully.
Jun 24 04:29:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-cbe65638-9d82-4756-84bb-8df2b5cb2801 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-b3fcbd6a-65b9-4cc3-86f2-7a405aeaf133-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:19 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf" returned: 0 in 0.656s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:29:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08d1afb-afdc-487f-94f7-eb0c43dc6240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a55142-9904-4cb4-8d96-e8604f6532bf', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad2199f-f8a0-4b03-b070-9c22f0f12926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:19 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Volume volume-c3a55142-9904-4cb4-8d96-e8604f6532bf (c3a55142-9904-4cb4-8d96-e8604f6532bf): created successfully
Jun 24 04:29:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad2199f-f8a0-4b03-b070-9c22f0f12926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:19 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Flow 'volume_create_manager' (b18169f2-a685-4e8f-b24e-a8cc999c858c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:19 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3d3919c7-1a6f-49a4-9b7f-61a2675d84d7 tempest-VolumesCloneTest-365191024 None] Created volume successfully.
Jun 24 04:29:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-fb788cf7-ebba-4616-921a-97dd24f5cc02-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-fb788cf7-ebba-4616-921a-97dd24f5cc02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cc1d33-517c-4ef4-8e31-97905a8f1967]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:20 devstack sudo[109525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02
Jun 24 04:29:20 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Flow 'volume_create_manager' (30b56767-4947-4d99-b298-ef91db5acc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb59ab5-22b8-4752-a924-bbae114d4661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb59ab5-22b8-4752-a924-bbae114d4661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-962997040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c4e9c1-4bb9-4498-b678-591817eb9e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf09378134c1402a9dfa5aa309743494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c3a55142-9904-4cb4-8d96-e8604f6532bf,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:20Z,use_quota=True,user_id='4eef284699bd474cbd110fe9da0745fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d4a83c-5074-4b83-8b49-17c125ab16bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d4a83c-5074-4b83-8b49-17c125ab16bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1baebf5b-456f-49b2-bc3a-d38d1c237d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1baebf5b-456f-49b2-bc3a-d38d1c237d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '97c4e9c1-4bb9-4498-b678-591817eb9e14', 'volume_name': 'volume-97c4e9c1-4bb9-4498-b678-591817eb9e14', 'volume_size': 2, 'source_volid': 'c3a55142-9904-4cb4-8d96-e8604f6532bf', 'source_volstatus': 'available'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717597b7-7367-42ae-aeb2-21c2574360e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717597b7-7367-42ae-aeb2-21c2574360e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c1cb37-0b69-428c-86f4-2c089cb43bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:20 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Volume 97c4e9c1-4bb9-4498-b678-591817eb9e14: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-97c4e9c1-4bb9-4498-b678-591817eb9e14', 'volume_size': 2, 'source_volid': 'c3a55142-9904-4cb4-8d96-e8604f6532bf', 'source_volstatus': 'available'}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:20 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Cloning volume c3a55142-9904-4cb4-8d96-e8604f6532bf to volume 97c4e9c1-4bb9-4498-b678-591817eb9e14
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Creating offline snapshot 0b1fa3ce-4778-417b-92da-56acb5cb04e8 of volume c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ad3840-0902-4f8c-b740-0248b814e35c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:20 devstack sudo[109527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf
Jun 24 04:29:20 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:20 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02" returned: 0 in 0.786s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:20 devstack sudo[109532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02
Jun 24 04:29:20 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:21 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf" returned: 0 in 0.800s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:21 devstack sudo[109537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 1G
Jun 24 04:29:21 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:21 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fb788cf7-ebba-4616-921a-97dd24f5cc02" returned: 0 in 0.676s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-quobyte-fb788cf7-ebba-4616-921a-97dd24f5cc02" released by "delete_volume" :: held 1.530s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Created reservations ['2b98e870-da50-4e8e-8203-ea2ffb7c26f3', '29e72a85-2170-49c9-a444-c7fecfbf5c96', '94bbfbe7-b5d7-48ee-a53e-3774b44a2655', '5bc26ae2-b13f-47f7-a47b-877d0a0e71c3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:21 devstack sudo[109540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:29:21 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:22 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 1G" returned: 0 in 0.820s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a55142-9904-4cb4-8d96-e8604f6532bf -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:22 devstack sudo[109545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a55142-9904-4cb4-8d96-e8604f6532bf -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8
Jun 24 04:29:22 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:22 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.718s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:22 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Deleted volume successfully.
Jun 24 04:29:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bdef1997-d6ec-4197-bafc-c014542cce13 tempest-VolumesSnapshotListTestJSON-493795403 None] Lock "cinder-fb788cf7-ebba-4616-921a-97dd24f5cc02-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:22 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a55142-9904-4cb4-8d96-e8604f6532bf -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8" returned: 0 in 0.781s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:22 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 is being set with open permissions: ugo+rw
Jun 24 04:29:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:22 devstack sudo[109551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8
Jun 24 04:29:22 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:23 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8" returned: 0 in 0.690s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:23 devstack sudo[109554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.info
Jun 24 04:29:23 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:24 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.info" returned: 0 in 0.682s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:24 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.info is being set with open permissions: ugo+rw
Jun 24 04:29:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:24 devstack sudo[109557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.info
Jun 24 04:29:24 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:25 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.info" returned: 0 in 0.676s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Acquiring lock "cinder-quobyte-97c4e9c1-4bb9-4498-b678-591817eb9e14" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Lock "cinder-quobyte-97c4e9c1-4bb9-4498-b678-591817eb9e14" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] snapshot: 0b1fa3ce-4778-417b-92da-56acb5cb04e8, volume: 97c4e9c1-4bb9-4498-b678-591817eb9e14,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d092ade7-5019-4f70-abed-3bd274d946aa]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:25 devstack sudo[109560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8
Jun 24 04:29:25 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:25 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8" returned: 0 in 0.835s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3a55142-9904-4cb4-8d96-e8604f6532bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed7d7b-d34b-4108-94b0-7283d076a362]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:26 devstack sudo[109565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf
Jun 24 04:29:26 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:26 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf" returned: 0 in 0.809s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:26 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14 not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:29:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:26 devstack sudo[109571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14
Jun 24 04:29:26 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:32 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14" returned: 0 in 5.318s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:32 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a162a8b-5edd-4a8b-bf54-d69e7a51eb80]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:32 devstack sudo[109584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf
Jun 24 04:29:32 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:33 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf" returned: 0 in 0.958s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:29:33 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Converted 1024.00 MB image at 192.50 MB/s
Jun 24 04:29:33 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14 is being set with open permissions: ugo+rw
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:33 devstack sudo[109590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14
Jun 24 04:29:33 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=38,cinder:INSERT=14,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:29:33 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14" returned: 0 in 0.673s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Lock "cinder-quobyte-97c4e9c1-4bb9-4498-b678-591817eb9e14" released by "_copy_volume_from_snapshot" :: held 8.689s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Acquiring lock "cinder-quobyte-0b1fa3ce-4778-417b-92da-56acb5cb04e8" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Lock "cinder-quobyte-0b1fa3ce-4778-417b-92da-56acb5cb04e8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Deleting offline snapshot 0b1fa3ce-4778-417b-92da-56acb5cb04e8 of volume c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] snapshot_file for this snap is: volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba719f-28b6-4d37-b015-169938f9f87e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:33 devstack sudo[109593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8
Jun 24 04:29:33 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:34 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8" returned: 0 in 0.804s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3a55142-9904-4cb4-8d96-e8604f6532bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c5181-f5df-4899-9f5c-7050b6843efa]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:34 devstack sudo[109599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf
Jun 24 04:29:34 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:35 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf" returned: 0 in 0.777s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:35 devstack sudo[109604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8
Jun 24 04:29:35 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:36 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8" returned: 0 in 0.835s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:36 devstack sudo[109610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8
Jun 24 04:29:36 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:37 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf.0b1fa3ce-4778-417b-92da-56acb5cb04e8" returned: 0 in 0.750s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Lock "cinder-quobyte-0b1fa3ce-4778-417b-92da-56acb5cb04e8" released by "_delete_snapshot" :: held 3.273s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.604s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c1cb37-0b69-428c-86f4-2c089cb43bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c4e9c1-4bb9-4498-b678-591817eb9e14', 'volume_size': 2, 'source_volid': 'c3a55142-9904-4cb4-8d96-e8604f6532bf', 'source_volstatus': 'available'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dbe2d1-0018-4213-bac9-518ac4111f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:37 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Volume volume-97c4e9c1-4bb9-4498-b678-591817eb9e14 (97c4e9c1-4bb9-4498-b678-591817eb9e14): created successfully
Jun 24 04:29:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dbe2d1-0018-4213-bac9-518ac4111f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Flow 'volume_create_manager' (30b56767-4947-4d99-b298-ef91db5acc1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:37 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4acde95e-b5bb-4ff2-a2cd-f33648692987 tempest-VolumesCloneTest-365191024 None] Created volume successfully.
Jun 24 04:29:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Acquiring lock "cinder-97c4e9c1-4bb9-4498-b678-591817eb9e14-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Lock "cinder-97c4e9c1-4bb9-4498-b678-591817eb9e14-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Acquiring lock "cinder-quobyte-97c4e9c1-4bb9-4498-b678-591817eb9e14" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Lock "cinder-quobyte-97c4e9c1-4bb9-4498-b678-591817eb9e14" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b1ece7-a4cd-469e-80c9-86452fe15f79]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:38 devstack sudo[109613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14
Jun 24 04:29:38 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:38 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14" returned: 0 in 0.816s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:38 devstack sudo[109618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14
Jun 24 04:29:38 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:39 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-97c4e9c1-4bb9-4498-b678-591817eb9e14" returned: 0 in 0.762s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Lock "cinder-quobyte-97c4e9c1-4bb9-4498-b678-591817eb9e14" released by "delete_volume" :: held 1.627s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Created reservations ['2f40b7d6-b8e2-4b86-a64e-47ea5d3a91c7', '9a9e43c0-39fc-4592-867c-cec83bd44c90', '31e4e746-c454-44fe-a640-5fba9db325c6', '793144c4-87d6-4735-9745-f791f68c268e'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:39 devstack sudo[109621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:29:39 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Acquiring lock "cinder-c3a55142-9904-4cb4-8d96-e8604f6532bf-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Lock "cinder-c3a55142-9904-4cb4-8d96-e8604f6532bf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Acquiring lock "cinder-quobyte-c3a55142-9904-4cb4-8d96-e8604f6532bf" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Lock "cinder-quobyte-c3a55142-9904-4cb4-8d96-e8604f6532bf" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6e96b-308f-42a5-ad3f-475048083ec6]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:40 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.702s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Deleted volume successfully.
Jun 24 04:29:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6d945479-6f19-4ab2-9f7a-2b26104a20bd tempest-VolumesCloneTest-365191024 None] Lock "cinder-97c4e9c1-4bb9-4498-b678-591817eb9e14-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:40 devstack sudo[109624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf
Jun 24 04:29:40 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:41 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf" returned: 0 in 0.828s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:41 devstack sudo[109630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf
Jun 24 04:29:41 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:42 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-c3a55142-9904-4cb4-8d96-e8604f6532bf" returned: 0 in 0.658s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Lock "cinder-quobyte-c3a55142-9904-4cb4-8d96-e8604f6532bf" released by "delete_volume" :: held 1.556s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Created reservations ['72124872-7fd5-451c-a1a4-578cbce2f017', '2f82ab4e-3a9a-4dd3-8e3e-851e6995e937', 'aeaf0aef-0f93-46df-8c97-54e347130cfc', 'cce9eb56-0d8f-4204-a46a-8abe6c85d1c1'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:42 devstack sudo[109633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:29:42 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:43 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.777s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:43 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:43 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Deleted volume successfully.
Jun 24 04:29:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe568eec-5f0c-435f-ba1e-bc3258efc55d tempest-VolumesCloneTest-365191024 None] Lock "cinder-c3a55142-9904-4cb4-8d96-e8604f6532bf-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:29:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:45 devstack sudo[109636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:29:45 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:46 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.727s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:29:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:29:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Flow 'volume_create_manager' (7647bfa6-c84b-42f6-87f7-e7724b23b27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40db27f0-d8ab-4caa-bfc4-0d31005f7db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40db27f0-d8ab-4caa-bfc4-0d31005f7db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-843967120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae9a30f-4980-42c1-a087-db7ec943b3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6210b7b332884610801eeca3ce57c4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:49Z,use_quota=True,user_id='1395355e1279487d9194557aa19c615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f08e840-dd04-49d4-ab8b-8a6a3574f4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f08e840-dd04-49d4-ab8b-8a6a3574f4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4840226d-0156-4406-b1fb-48643e68404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4840226d-0156-4406-b1fb-48643e68404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae9a30f-4980-42c1-a087-db7ec943b3bd', 'volume_name': 'volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b6bc02-f995-427e-aa92-19f3218a708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b6bc02-f995-427e-aa92-19f3218a708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e50065e-09e5-4a48-a948-8673cd7452e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Volume 5ae9a30f-4980-42c1-a087-db7ec943b3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd', 'volume_size': 1}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-843967120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae9a30f-4980-42c1-a087-db7ec943b3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6210b7b332884610801eeca3ce57c4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:49Z,use_quota=True,user_id='1395355e1279487d9194557aa19c615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Creating volume 5ae9a30f-4980-42c1-a087-db7ec943b3bd {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:49 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:49 devstack sudo[109640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd 1073741824
Jun 24 04:29:49 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Flow 'volume_create_manager' (d9885996-f7df-4e06-bac8-764db865d69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb83ac9d-91a1-459d-95ae-4329c51d4ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb83ac9d-91a1-459d-95ae-4329c51d4ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1399758535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946d5921-16ec-4c66-9203-576cbf616cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6210b7b332884610801eeca3ce57c4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:50Z,use_quota=True,user_id='1395355e1279487d9194557aa19c615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb49d6a-9f83-4a8b-838f-6e2b13b0577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb49d6a-9f83-4a8b-838f-6e2b13b0577e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6169e79-9ead-48ea-b0a6-aae94761c5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6169e79-9ead-48ea-b0a6-aae94761c5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946d5921-16ec-4c66-9203-576cbf616cbb', 'volume_name': 'volume-946d5921-16ec-4c66-9203-576cbf616cbb', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17983f90-6d68-42c0-adef-14831a27c923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17983f90-6d68-42c0-adef-14831a27c923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e98fc2-5069-4ac3-9a94-2e1f9f15ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Volume 946d5921-16ec-4c66-9203-576cbf616cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946d5921-16ec-4c66-9203-576cbf616cbb', 'volume_size': 1}
Jun 24 04:29:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:50 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd 1073741824" returned: 0 in 1.134s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:50 devstack sudo[109646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd
Jun 24 04:29:50 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:51 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd" returned: 0 in 0.662s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1399758535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946d5921-16ec-4c66-9203-576cbf616cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6210b7b332884610801eeca3ce57c4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:50Z,use_quota=True,user_id='1395355e1279487d9194557aa19c615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Creating volume 946d5921-16ec-4c66-9203-576cbf616cbb {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:51 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e50065e-09e5-4a48-a948-8673cd7452e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bbab04-0a0f-4ef1-a9e2-65f0b9bdc8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:51 devstack sudo[109649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb 1073741824
Jun 24 04:29:51 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:51 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Volume volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd (5ae9a30f-4980-42c1-a087-db7ec943b3bd): created successfully
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bbab04-0a0f-4ef1-a9e2-65f0b9bdc8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Flow 'volume_create_manager' (7647bfa6-c84b-42f6-87f7-e7724b23b27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9f9ccf95-a86b-4052-b965-07d8189f7150 tempest-TestServerVolumeAttachmentScenario-521553112 None] Created volume successfully.
Jun 24 04:29:52 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb 1073741824" returned: 0 in 1.115s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:52 devstack sudo[109655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb
Jun 24 04:29:52 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:53 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb" returned: 0 in 0.687s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:29:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e98fc2-5069-4ac3-9a94-2e1f9f15ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946d5921-16ec-4c66-9203-576cbf616cbb', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da53770-0d7d-4539-abbd-22acda064f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:53 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Volume volume-946d5921-16ec-4c66-9203-576cbf616cbb (946d5921-16ec-4c66-9203-576cbf616cbb): created successfully
Jun 24 04:29:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da53770-0d7d-4539-abbd-22acda064f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Flow 'volume_create_manager' (d9885996-f7df-4e06-bac8-764db865d69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6feda6cf-cff8-47b2-8f69-bb2cf2cdb8c3 tempest-TestServerVolumeAttachmentScenario-521553112 None] Created volume successfully.
Jun 24 04:30:03 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=26,cinder:SELECT=18,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:30:03 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=26,cinder:SELECT=13,cinder:DELETE=4,cinder:INSERT=4 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:30:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-ba2ceb43-580c-4f2b-8b2f-45132053d905 req-00d9f970-4bfd-4e8e-9f62-bddfdfe43146 tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-ba2ceb43-580c-4f2b-8b2f-45132053d905 req-00d9f970-4bfd-4e8e-9f62-bddfdfe43146 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:39 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342a074-ce3c-4bfc-979a-e2f06d6b2c32]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-ba2ceb43-580c-4f2b-8b2f-45132053d905 req-00d9f970-4bfd-4e8e-9f62-bddfdfe43146 tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:39 devstack sudo[109982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd
Jun 24 04:30:39 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:40 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-ba2ceb43-580c-4f2b-8b2f-45132053d905 req-00d9f970-4bfd-4e8e-9f62-bddfdfe43146 tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd" returned: 0 in 0.741s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-ba2ceb43-580c-4f2b-8b2f-45132053d905 req-00d9f970-4bfd-4e8e-9f62-bddfdfe43146 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.760s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:40 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-ba2ceb43-580c-4f2b-8b2f-45132053d905 req-00d9f970-4bfd-4e8e-9f62-bddfdfe43146 tempest-TestServerVolumeAttachmentScenario-521553112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b06d49e8-2f59-4ff2-8541-49e4c9e08d2c', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:30:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-ba2ceb43-580c-4f2b-8b2f-45132053d905 req-00d9f970-4bfd-4e8e-9f62-bddfdfe43146 tempest-TestServerVolumeAttachmentScenario-521553112 None] attachment_update completed successfully.
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:45 devstack sudo[110372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:30:45 devstack sudo[110372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:45 devstack sudo[110372]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.681s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:30:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Flow 'volume_create_manager' (ac21100e-f9d4-4111-8080-b956e57652dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e7c78b-31ee-4b5d-8254-6692dee5923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e7c78b-31ee-4b5d-8254-6692dee5923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2115207882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cec00d2-fbfc-418c-bf44-8ded756bfd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ce047fd9444142a80fad6be74c12b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:30:48Z,use_quota=True,user_id='cc65c8e759924cb9ba662738695c9b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fee2dc-ece5-489d-b8e9-42653affe339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fee2dc-ece5-489d-b8e9-42653affe339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7a4cef-3548-4d0e-9df3-96943b7b230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7a4cef-3548-4d0e-9df3-96943b7b230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cec00d2-fbfc-418c-bf44-8ded756bfd63', 'volume_name': 'volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2302dd-951f-4fab-b3e3-cd8c9bf367af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2302dd-951f-4fab-b3e3-cd8c9bf367af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc98312c-c124-4eb2-92a6-d24ea9f59bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:47 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Volume 9cec00d2-fbfc-418c-bf44-8ded756bfd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63', 'volume_size': 1}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2115207882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cec00d2-fbfc-418c-bf44-8ded756bfd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ce047fd9444142a80fad6be74c12b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:30:48Z,use_quota=True,user_id='cc65c8e759924cb9ba662738695c9b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Creating volume 9cec00d2-fbfc-418c-bf44-8ded756bfd63 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:30:47 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:30:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:47 devstack sudo[110381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63 1073741824
Jun 24 04:30:47 devstack sudo[110381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:48 devstack sudo[110381]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63 1073741824" returned: 0 in 0.826s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:48 devstack sudo[110386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63
Jun 24 04:30:48 devstack sudo[110386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:49 devstack sudo[110386]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63" returned: 0 in 0.712s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc98312c-c124-4eb2-92a6-d24ea9f59bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2ca0dc-6a58-419e-90a1-f1d312d6bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Volume volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63 (9cec00d2-fbfc-418c-bf44-8ded756bfd63): created successfully
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2ca0dc-6a58-419e-90a1-f1d312d6bce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Flow 'volume_create_manager' (ac21100e-f9d4-4111-8080-b956e57652dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:30:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-eeb9f5e8-790e-4e2e-93c1-3a926cf9d3dc tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Created volume successfully.
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-85c40ddf-e324-43c9-bcc6-1e4bc8eb079c req-da63b484-0ab4-4bc7-a64b-9a074b7d6e4b tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-85c40ddf-e324-43c9-bcc6-1e4bc8eb079c req-da63b484-0ab4-4bc7-a64b-9a074b7d6e4b tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca4c14d-1a42-482e-86ea-aebf97e2c73e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-85c40ddf-e324-43c9-bcc6-1e4bc8eb079c req-da63b484-0ab4-4bc7-a64b-9a074b7d6e4b tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:50 devstack sudo[110397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb
Jun 24 04:30:50 devstack sudo[110397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:50 devstack sudo[110397]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-85c40ddf-e324-43c9-bcc6-1e4bc8eb079c req-da63b484-0ab4-4bc7-a64b-9a074b7d6e4b tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb" returned: 0 in 0.764s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-85c40ddf-e324-43c9-bcc6-1e4bc8eb079c req-da63b484-0ab4-4bc7-a64b-9a074b7d6e4b tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.783s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-85c40ddf-e324-43c9-bcc6-1e4bc8eb079c req-da63b484-0ab4-4bc7-a64b-9a074b7d6e4b tempest-TestServerVolumeAttachmentScenario-521553112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-946d5921-16ec-4c66-9203-576cbf616cbb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bc9f58a-0d95-4c87-b6e4-3d948e0ea5c0', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:30:50 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-85c40ddf-e324-43c9-bcc6-1e4bc8eb079c req-da63b484-0ab4-4bc7-a64b-9a074b7d6e4b tempest-TestServerVolumeAttachmentScenario-521553112 None] attachment_update completed successfully.
Jun 24 04:30:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-2e28d427-8772-4cc3-b759-3dcb28157998 req-b79af4d4-97a7-4a6a-8442-a5f383d18367 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-2e28d427-8772-4cc3-b759-3dcb28157998 req-b79af4d4-97a7-4a6a-8442-a5f383d18367 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:52 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d504a17d-abcb-4023-8641-eab05d58a69f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-2e28d427-8772-4cc3-b759-3dcb28157998 req-b79af4d4-97a7-4a6a-8442-a5f383d18367 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:53 devstack sudo[110418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63
Jun 24 04:30:53 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:53 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-2e28d427-8772-4cc3-b759-3dcb28157998 req-b79af4d4-97a7-4a6a-8442-a5f383d18367 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63" returned: 0 in 0.777s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-2e28d427-8772-4cc3-b759-3dcb28157998 req-b79af4d4-97a7-4a6a-8442-a5f383d18367 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.793s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-2e28d427-8772-4cc3-b759-3dcb28157998 req-b79af4d4-97a7-4a6a-8442-a5f383d18367 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82e0672b-928c-461e-9c14-08c369668ff0', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:30:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-2e28d427-8772-4cc3-b759-3dcb28157998 req-b79af4d4-97a7-4a6a-8442-a5f383d18367 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] attachment_update completed successfully.
Jun 24 04:30:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-72d56123-0693-486f-b634-94eb90de54e2 req-1cbfb8e7-7d2f-44ce-a0a3-bfd5d26b6d07 tempest-TestServerVolumeAttachmentScenario-521553112 None] Terminate volume connection completed successfully.
Jun 24 04:30:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-72d56123-0693-486f-b634-94eb90de54e2 req-1cbfb8e7-7d2f-44ce-a0a3-bfd5d26b6d07 tempest-TestServerVolumeAttachmentScenario-521553112 None] Deleting attachment 0bc9f58a-0d95-4c87-b6e4-3d948e0ea5c0. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:31:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-2e2431dd-22d8-4e21-8901-957cec54d043 req-7483f715-f780-4787-a92a-a5f6edba1670 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Terminate volume connection completed successfully.
Jun 24 04:31:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-2e2431dd-22d8-4e21-8901-957cec54d043 req-7483f715-f780-4787-a92a-a5f6edba1670 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Deleting attachment 82e0672b-928c-461e-9c14-08c369668ff0. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:31:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-59e3729a-00b2-47b4-bc85-eb4f61bbd5d6 req-12f4013d-b44a-4984-98c1-d7a0510107e0 tempest-TestServerVolumeAttachmentScenario-521553112 None] Terminate volume connection completed successfully.
Jun 24 04:31:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-59e3729a-00b2-47b4-bc85-eb4f61bbd5d6 req-12f4013d-b44a-4984-98c1-d7a0510107e0 tempest-TestServerVolumeAttachmentScenario-521553112 None] Deleting attachment b06d49e8-2f59-4ff2-8541-49e4c9e08d2c. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:31:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Acquiring lock "cinder-9cec00d2-fbfc-418c-bf44-8ded756bfd63-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "cinder-9cec00d2-fbfc-418c-bf44-8ded756bfd63-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Acquiring lock "cinder-quobyte-9cec00d2-fbfc-418c-bf44-8ded756bfd63" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:02 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "cinder-quobyte-9cec00d2-fbfc-418c-bf44-8ded756bfd63" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:02 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a670b-a34a-46ed-b300-c77e1b4e2101]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:02 devstack sudo[110477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63
Jun 24 04:31:02 devstack sudo[110477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:02 devstack sudo[110477]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63" returned: 0 in 0.843s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:02 devstack sudo[110483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63
Jun 24 04:31:02 devstack sudo[110483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:03 devstack sudo[110483]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9cec00d2-fbfc-418c-bf44-8ded756bfd63" returned: 0 in 0.740s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "cinder-quobyte-9cec00d2-fbfc-418c-bf44-8ded756bfd63" released by "delete_volume" :: held 1.646s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Created reservations ['94e1391c-4f9a-4ff8-8bec-515017299bfc', 'a08749db-1623-402d-9c2a-04b1ac7bc97e', 'e24a4961-3ccb-49a6-8d6f-1d3e51a5c6fb', '989200cd-6b0d-4d7c-b1c1-09a454e68892'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:03 devstack sudo[110524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:31:03 devstack sudo[110524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:04 devstack sudo[110524]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.751s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:04 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:31:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Deleted volume successfully.
Jun 24 04:31:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-b53a1f53-81d7-4faa-b16d-45281728f314 tempest-TestServerVolumeAttachScenarioOldVersion-913401922 None] Lock "cinder-9cec00d2-fbfc-418c-bf44-8ded756bfd63-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:31:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "cinder-946d5921-16ec-4c66-9203-576cbf616cbb-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "cinder-946d5921-16ec-4c66-9203-576cbf616cbb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "cinder-quobyte-946d5921-16ec-4c66-9203-576cbf616cbb" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "cinder-quobyte-946d5921-16ec-4c66-9203-576cbf616cbb" acquired by "delete_volume" :: waited 0.040s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:11 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b16942d-195d-44a2-a7d4-b649606232e5]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:12 devstack sudo[110584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb
Jun 24 04:31:12 devstack sudo[110584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:12 devstack sudo[110584]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb" returned: 0 in 0.767s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:12 devstack sudo[110589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb
Jun 24 04:31:12 devstack sudo[110589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:13 devstack sudo[110589]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-946d5921-16ec-4c66-9203-576cbf616cbb" returned: 0 in 0.664s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "cinder-quobyte-946d5921-16ec-4c66-9203-576cbf616cbb" released by "delete_volume" :: held 1.494s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Created reservations ['92ede6ed-cbcc-4396-8919-77c4b0e75a3a', 'f8b940b5-1bbe-4a22-b843-4c0144e28b1b', 'c04f0bae-3b59-45f4-9321-ddf46a499f8c', '238b8811-fc8a-4359-8a23-69a717622b50'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:13 devstack sudo[110592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:31:13 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "cinder-5ae9a30f-4980-42c1-a087-db7ec943b3bd-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "cinder-5ae9a30f-4980-42c1-a087-db7ec943b3bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "cinder-quobyte-5ae9a30f-4980-42c1-a087-db7ec943b3bd" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "cinder-quobyte-5ae9a30f-4980-42c1-a087-db7ec943b3bd" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a089129-ceb5-46bc-9753-fcd0d3560167]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:14 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.724s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:31:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Deleted volume successfully.
Jun 24 04:31:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1de370ba-ca9d-49bb-ba66-fdd5b38680c8 tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "cinder-946d5921-16ec-4c66-9203-576cbf616cbb-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:31:14 devstack sudo[110596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd
Jun 24 04:31:14 devstack sudo[110596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:15 devstack sudo[110596]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd" returned: 0 in 0.848s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:15 devstack sudo[110602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd
Jun 24 04:31:15 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:15 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5ae9a30f-4980-42c1-a087-db7ec943b3bd" returned: 0 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "cinder-quobyte-5ae9a30f-4980-42c1-a087-db7ec943b3bd" released by "delete_volume" :: held 1.652s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Created reservations ['f9f453e2-7962-41ae-b4d4-e9d114154204', 'bf511333-3d64-467d-b7ac-1d8c67c2b634', 'ced9fab7-0ac0-4a76-ba55-f3cc66cd624a', 'f9b9c09f-2d94-4860-b7aa-54b5e49bf7ca'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:16 devstack sudo[110605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:31:16 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:16 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.733s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:16 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:31:16 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Deleted volume successfully.
Jun 24 04:31:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-3b7ec6cd-0279-454c-bb79-82bd879d970b tempest-TestServerVolumeAttachmentScenario-521553112 None] Lock "cinder-5ae9a30f-4980-42c1-a087-db7ec943b3bd-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:31:25 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=34,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:31:26 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=39,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:31:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:31:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:45 devstack sudo[110655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:31:45 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:46 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.744s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:31:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:31:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:31:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:31:48 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:31:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Flow 'volume_create_manager' (798ff8a0-1f22-402f-9257-651e107e447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:31:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0c07d8-35f2-4924-8825-48fa2d32ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0c07d8-35f2-4924-8825-48fa2d32ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1339855911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a78dd21-baf7-4bcc-8e78-2a86f647e179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf1cd5c3dc34a0eae55a3281d58b68b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:31:48Z,use_quota=True,user_id='2f8cf767478f4dc0aa7eb69f3800c468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a09d4c-39d8-401d-a621-3b1b0d0be0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a09d4c-39d8-401d-a621-3b1b0d0be0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:48 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9bb1f6-73a2-41a5-8e99-2af6d520eb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:48 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:31:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9bb1f6-73a2-41a5-8e99-2af6d520eb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a78dd21-baf7-4bcc-8e78-2a86f647e179', 'volume_name': 'volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76ae63c0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7939b226-9a6c-4f30-8e26-44e24214caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7939b226-9a6c-4f30-8e26-44e24214caaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d649f4-4e47-4c44-9b0e-e3ab4fc13b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Volume 4a78dd21-baf7-4bcc-8e78-2a86f647e179: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76ae63c0>}
Jun 24 04:31:49 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Trying to clone 4a78dd21-baf7-4bcc-8e78-2a86f647e179 from image 1fe711f9-301b-47ca-8464-f7cda30438a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:31:49 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:31:49 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Image download 20.69 MB at 20.69 MB/s
Jun 24 04:31:49 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85fff52-a4dd-4118-857e-d54868b17e51]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:49 devstack sudo[110660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD
Jun 24 04:31:49 devstack sudo[110660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:50 devstack sudo[110660]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:50 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Temporary image 1fe711f9-301b-47ca-8464-f7cda30438a4 is fetched for user 2f8cf767478f4dc0aa7eb69f3800c468. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:31:50 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a735b3ce-5483-4881-b20c-313192d1fb70]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:50 devstack sudo[110665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD
Jun 24 04:31:50 devstack sudo[110665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:51 devstack sudo[110665]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1339855911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a78dd21-baf7-4bcc-8e78-2a86f647e179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf1cd5c3dc34a0eae55a3281d58b68b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:31:48Z,use_quota=True,user_id='2f8cf767478f4dc0aa7eb69f3800c468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Creating volume 4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:31:51 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:31:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:51 devstack sudo[110671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 1073741824
Jun 24 04:31:51 devstack sudo[110671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:52 devstack sudo[110671]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 1073741824" returned: 0 in 1.003s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:52 devstack sudo[110677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:31:52 devstack sudo[110677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:53 devstack sudo[110677]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 0 in 0.772s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:31:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:53 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Attempting download of 1fe711f9-301b-47ca-8464-f7cda30438a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}])) to volume 4a78dd21-baf7-4bcc-8e78-2a86f647e179. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:31:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[66121818-6de7-4a70-90b3-020563882ca7]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_j5ruptyw {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:53 devstack sudo[110680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_j5ruptyw
Jun 24 04:31:53 devstack sudo[110680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:54 devstack sudo[110680]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_j5ruptyw" returned: 0 in 0.770s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_j5ruptyw {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:54 devstack sudo[110684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_j5ruptyw
Jun 24 04:31:54 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:54 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_j5ruptyw" returned: 1 in 0.756s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fe711f9-301b-47ca-8464-f7cda30438a4_j5ruptyw' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:31:54 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a99d82-e6e0-4106-9c5c-41bb73e6da5b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:54 devstack sudo[110688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD
Jun 24 04:31:54 devstack sudo[110688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:55 devstack sudo[110688]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] 1fe711f9-301b-47ca-8464-f7cda30438a4 was qcow2, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:55 devstack sudo[110700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:31:55 devstack sudo[110700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Flow 'volume_create_manager' (49083bae-2ce1-40e0-96d6-756d6cc0372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e00e4e-8372-4b88-9f19-a68be0b992c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e00e4e-8372-4b88-9f19-a68be0b992c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1460221523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f9261c-b9e2-46dd-bf3f-a7332db2b117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9cc76f82ea44b78116bc2b8003358e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:31:56Z,use_quota=True,user_id='e57b9d7111cf4340b4fc2c5aa512ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4547d0-e903-4b28-84f2-114b27bbfc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4547d0-e903-4b28-84f2-114b27bbfc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04328fd-552e-4b15-b574-6f6615aa7ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04328fd-552e-4b15-b574-6f6615aa7ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f9261c-b9e2-46dd-bf3f-a7332db2b117', 'volume_name': 'volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20fcf7f-a34c-4cd5-a19d-5896a1e7f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20fcf7f-a34c-4cd5-a19d-5896a1e7f22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5d820f-a733-4038-9b92-41512e04cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:55 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Volume e2f9261c-b9e2-46dd-bf3f-a7332db2b117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117', 'volume_size': 1}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1460221523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f9261c-b9e2-46dd-bf3f-a7332db2b117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9cc76f82ea44b78116bc2b8003358e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:31:56Z,use_quota=True,user_id='e57b9d7111cf4340b4fc2c5aa512ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Creating volume e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:31:55 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:31:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:55 devstack sudo[110702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 1073741824
Jun 24 04:31:55 devstack sudo[110702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:56 devstack sudo[110702]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 1073741824" returned: 0 in 1.003s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:56 devstack sudo[110724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117
Jun 24 04:31:56 devstack sudo[110724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:57 devstack sudo[110724]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" returned: 0 in 0.783s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5d820f-a733-4038-9b92-41512e04cf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa591284-502c-4413-8de0-351b60498592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:57 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Volume volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 (e2f9261c-b9e2-46dd-bf3f-a7332db2b117): created successfully
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa591284-502c-4413-8de0-351b60498592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Flow 'volume_create_manager' (49083bae-2ce1-40e0-96d6-756d6cc0372a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:31:57 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a7cd42ce-c0f9-4f01-b528-d9b6f312f75e tempest-TestStampPattern-1334218967 None] Created volume successfully.
Jun 24 04:31:57 devstack sudo[110700]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 0 in 2.169s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fe711f9-301b-47ca-8464-f7cda30438a4_06zel_tbdevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:31:57 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Converted 112.00 MB image at 51.61 MB/s
Jun 24 04:31:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:57 devstack sudo[110727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 1G
Jun 24 04:31:57 devstack sudo[110727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:58 devstack sudo[110727]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 1G" returned: 0 in 0.731s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:58 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b40ae10-fa97-4eb2-90d3-4c39de142e69]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:58 devstack sudo[110732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:31:58 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:59 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 0 in 0.783s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:59 devstack sudo[110736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:31:59 devstack sudo[110736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:00 devstack sudo[110736]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 1 in 0.748s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Downloaded image 1fe711f9-301b-47ca-8464-f7cda30438a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}])) to volume 4a78dd21-baf7-4bcc-8e78-2a86f647e179 successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Temporary image 1fe711f9-301b-47ca-8464-f7cda30438a4 for user 2f8cf767478f4dc0aa7eb69f3800c468 is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Marking volume 4a78dd21-baf7-4bcc-8e78-2a86f647e179 as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Copying metadata from image 1fe711f9-301b-47ca-8464-f7cda30438a4 to 4a78dd21-baf7-4bcc-8e78-2a86f647e179. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Creating volume glance metadata for volume 4a78dd21-baf7-4bcc-8e78-2a86f647e179 backed by image 1fe711f9-301b-47ca-8464-f7cda30438a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d649f4-4e47-4c44-9b0e-e3ab4fc13b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179', 'volume_size': 1, 'image_id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fe711f9-301b-47ca-8464-f7cda30438a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd46e70bd2ef24cf1b3ffb2814a3609cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fe711f9-301b-47ca-8464-f7cda30438a4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fe711f9-301b-47ca-8464-f7cda30438a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76ae63c0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797468d4-8433-4c0f-a7ab-c424bef0b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:00 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Volume volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 (4a78dd21-baf7-4bcc-8e78-2a86f647e179): created successfully
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797468d4-8433-4c0f-a7ab-c424bef0b955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Flow 'volume_create_manager' (798ff8a0-1f22-402f-9257-651e107e447c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-aa74aa3e-d6e3-4580-8631-b22214d4c97c tempest-TestShelveInstance-929814486 None] Created volume successfully.
Jun 24 04:32:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:09 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e62d6c-3504-4255-a80a-4f89e9570b23]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:09 devstack sudo[110855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:32:09 devstack sudo[110855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:10 devstack sudo[110855]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 0 in 1.219s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:10 devstack sudo[110871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:32:10 devstack sudo[110871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:11 devstack sudo[110871]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 1 in 0.910s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:32:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.219s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:11 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1917dff1-03d1-4fa7-9646-e73c28bda6d1', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:32:11 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-50950142-e62f-426d-8d88-a071b4961663 req-2647e1a4-abd2-405f-88ab-c1ec45c16fc1 tempest-TestShelveInstance-929814486 None] attachment_update completed successfully.
Jun 24 04:32:21 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=13,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:32:21 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:32:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-3222b02a-071c-4a5b-8e0a-2524d4c53e5d req-838c73d2-d055-48fc-9afa-da58ecbb0f64 tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-3222b02a-071c-4a5b-8e0a-2524d4c53e5d req-838c73d2-d055-48fc-9afa-da58ecbb0f64 tempest-TestStampPattern-1334218967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0445ec-b299-459e-967e-1e90c8611751]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-3222b02a-071c-4a5b-8e0a-2524d4c53e5d req-838c73d2-d055-48fc-9afa-da58ecbb0f64 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:38 devstack sudo[111526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117
Jun 24 04:32:38 devstack sudo[111526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:38 devstack sudo[111526]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-3222b02a-071c-4a5b-8e0a-2524d4c53e5d req-838c73d2-d055-48fc-9afa-da58ecbb0f64 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" returned: 0 in 0.759s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-3222b02a-071c-4a5b-8e0a-2524d4c53e5d req-838c73d2-d055-48fc-9afa-da58ecbb0f64 tempest-TestStampPattern-1334218967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:38 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-3222b02a-071c-4a5b-8e0a-2524d4c53e5d req-838c73d2-d055-48fc-9afa-da58ecbb0f64 tempest-TestStampPattern-1334218967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b145321-341e-430b-b11a-b146bf7f5f38', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:32:39 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-3222b02a-071c-4a5b-8e0a-2524d4c53e5d req-838c73d2-d055-48fc-9afa-da58ecbb0f64 tempest-TestStampPattern-1334218967 None] attachment_update completed successfully.
Jun 24 04:32:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:32:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:45 devstack sudo[111578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:32:45 devstack sudo[111578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:46 devstack sudo[111578]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.759s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:32:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:32:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:32:47 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-ed95ce1d-8aca-4d49-be5b-1105eb1f3df2 req-f8108a0f-d27a-4021-b7f3-25bfad7c86d6 tempest-TestStampPattern-1334218967 None] Terminate volume connection completed successfully.
Jun 24 04:32:47 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-ed95ce1d-8aca-4d49-be5b-1105eb1f3df2 req-f8108a0f-d27a-4021-b7f3-25bfad7c86d6 tempest-TestStampPattern-1334218967 None] Deleting attachment 8b145321-341e-430b-b11a-b146bf7f5f38. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:32:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-df5add36-2066-488f-abc9-c2f85b7bef0b req-a61ac1aa-7a21-43af-96de-c5bd98e3c0b6 tempest-TestShelveInstance-929814486 None] Terminate volume connection completed successfully.
Jun 24 04:32:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-df5add36-2066-488f-abc9-c2f85b7bef0b req-a61ac1aa-7a21-43af-96de-c5bd98e3c0b6 tempest-TestShelveInstance-929814486 None] Deleting attachment 1917dff1-03d1-4fa7-9646-e73c28bda6d1. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:32:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Creating offline snapshot bd40fb29-2763-47f0-b886-f4b28c52e7f1 of volume e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:32:49 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da95e17-7e1d-405b-9b75-8bc0bcd6c9de]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:49 devstack sudo[111615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117
Jun 24 04:32:49 devstack sudo[111615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:50 devstack sudo[111615]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" returned: 0 in 0.761s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:50 devstack sudo[111620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 1G
Jun 24 04:32:50 devstack sudo[111620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:51 devstack sudo[111620]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 1G" returned: 0 in 0.816s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:51 devstack sudo[111626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1
Jun 24 04:32:51 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:51 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1" returned: 0 in 0.754s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:51 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 is being set with open permissions: ugo+rw
Jun 24 04:32:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:51 devstack sudo[111634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1
Jun 24 04:32:51 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:52 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1" returned: 0 in 0.691s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:52 devstack sudo[111638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.info
Jun 24 04:32:52 devstack sudo[111638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:53 devstack sudo[111638]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.info" returned: 0 in 0.658s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:53 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.info is being set with open permissions: ugo+rw
Jun 24 04:32:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:53 devstack sudo[111641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.info
Jun 24 04:32:53 devstack sudo[111641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:53 devstack sudo[111641]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.info" returned: 0 in 0.648s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.411s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-117370b3-190e-4511-9f95-bdcd7f5e9609 tempest-TestStampPattern-1334218967 None] Create snapshot completed successfully
Jun 24 04:32:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:54 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9898c022-2eb6-4d92-8b3b-cdfd7046119a]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:54 devstack sudo[111652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:32:54 devstack sudo[111652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:55 devstack sudo[111652]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 0 in 0.756s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:55 devstack sudo[111656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:32:55 devstack sudo[111656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:55 devstack sudo[111656]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 1 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:32:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.554s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:55 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6abc7c5a-bc1c-40e1-98b9-8a44c56d97cc', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:32:55 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-cb0c872c-a161-47a5-bc7a-2dcc33e65895 req-53d5b77f-58bd-482b-9f1a-19cfe35fbdca tempest-TestShelveInstance-929814486 None] attachment_update completed successfully.
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Flow 'volume_create_manager' (bcce5763-4b33-4a1a-b0d8-f44dc83c1562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48acbfc3-00d2-442d-8227-304420767c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48acbfc3-00d2-442d-8227-304420767c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1196111083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66340f2c-6294-4a2c-8895-28ec94b8b5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9cc76f82ea44b78116bc2b8003358e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd40fb29-2763-47f0-b886-f4b28c52e7f1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:05Z,use_quota=True,user_id='e57b9d7111cf4340b4fc2c5aa512ed51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f751d3d-bc1b-40ae-b0fe-1851b0edb37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f751d3d-bc1b-40ae-b0fe-1851b0edb37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd5e959-3d58-4f5c-be35-a621c7542faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd5e959-3d58-4f5c-be35-a621c7542faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66340f2c-6294-4a2c-8895-28ec94b8b5cf', 'volume_name': 'volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf', 'volume_size': 1, 'snapshot_id': 'bd40fb29-2763-47f0-b886-f4b28c52e7f1'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00117c0-4a2a-41bd-b0f2-c56d8c6e7e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00117c0-4a2a-41bd-b0f2-c56d8c6e7e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d64a87e-7bec-4440-bcdb-4d5bc6689d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:04 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Volume 66340f2c-6294-4a2c-8895-28ec94b8b5cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf', 'volume_size': 1, 'snapshot_id': 'bd40fb29-2763-47f0-b886-f4b28c52e7f1'}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-quobyte-bd40fb29-2763-47f0-b886-f4b28c52e7f1-66340f2c-6294-4a2c-8895-28ec94b8b5cf" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-bd40fb29-2763-47f0-b886-f4b28c52e7f1-66340f2c-6294-4a2c-8895-28ec94b8b5cf" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Creating volume 66340f2c-6294-4a2c-8895-28ec94b8b5cf from snapshot bd40fb29-2763-47f0-b886-f4b28c52e7f1 {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-quobyte-66340f2c-6294-4a2c-8895-28ec94b8b5cf" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-66340f2c-6294-4a2c-8895-28ec94b8b5cf" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] snapshot: bd40fb29-2763-47f0-b886-f4b28c52e7f1, volume: 66340f2c-6294-4a2c-8895-28ec94b8b5cf,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2358b4b8-e678-4057-b751-fa8d6f644cd3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:04 devstack sudo[111771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1
Jun 24 04:33:04 devstack sudo[111771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:05 devstack sudo[111771]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1" returned: 0 in 0.828s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:33:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:33:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:33:05 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[30670b83-ba39-4572-9b6b-f0c840c5391c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:05 devstack sudo[111784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117
Jun 24 04:33:05 devstack sudo[111784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:06 devstack sudo[111784]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" returned: 0 in 0.819s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:06 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:33:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:06 devstack sudo[111791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf
Jun 24 04:33:06 devstack sudo[111791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:14 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:33:14 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=18,cinder:UPDATE=5 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:33:14 devstack sudo[111791]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf" returned: 0 in 8.497s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:15 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3610b0e7-09ec-4038-94ae-9f814aa753f9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:15 devstack sudo[112205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117
Jun 24 04:33:15 devstack sudo[112205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:16 devstack sudo[112205]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" returned: 0 in 1.389s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:16 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117, size 1024.00 MB, duration 8.50 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:33:16 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Converted 1024.00 MB image at 120.50 MB/s
Jun 24 04:33:16 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf is being set with open permissions: ugo+rw
Jun 24 04:33:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:16 devstack sudo[112212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf
Jun 24 04:33:16 devstack sudo[112212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:17 devstack sudo[112212]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf" returned: 0 in 0.807s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-66340f2c-6294-4a2c-8895-28ec94b8b5cf" released by "_copy_volume_from_snapshot" :: held 12.449s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-bd40fb29-2763-47f0-b886-f4b28c52e7f1-66340f2c-6294-4a2c-8895-28ec94b8b5cf" released by "_create_volume_from_snapshot" :: held 12.480s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.499s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d64a87e-7bec-4440-bcdb-4d5bc6689d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf', 'volume_size': 1, 'snapshot_id': 'bd40fb29-2763-47f0-b886-f4b28c52e7f1'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b135df5-e45a-46c2-bbb7-3ddfafca0a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:17 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Volume volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf (66340f2c-6294-4a2c-8895-28ec94b8b5cf): created successfully
Jun 24 04:33:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b135df5-e45a-46c2-bbb7-3ddfafca0a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:17 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Flow 'volume_create_manager' (bcce5763-4b33-4a1a-b0d8-f44dc83c1562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:17 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0c24eacb-3905-4a8c-bd54-483e2d85ea19 tempest-TestStampPattern-1334218967 None] Created volume successfully.
Jun 24 04:33:27 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=2 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:33:27 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:45 devstack sudo[112386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:33:45 devstack sudo[112386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:45 devstack sudo[112386]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.679s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:33:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:33:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-497b852d-5647-4471-9bb5-7d4eb7282680 tempest-TestShelveInstance-929814486 None] Terminate volume connection completed successfully.
Jun 24 04:33:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-497b852d-5647-4471-9bb5-7d4eb7282680 tempest-TestShelveInstance-929814486 None] Deleting attachment 6abc7c5a-bc1c-40e1-98b9-8a44c56d97cc. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:33:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Acquiring lock "cinder-4a78dd21-baf7-4bcc-8e78-2a86f647e179-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Lock "cinder-4a78dd21-baf7-4bcc-8e78-2a86f647e179-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Acquiring lock "cinder-quobyte-4a78dd21-baf7-4bcc-8e78-2a86f647e179" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Lock "cinder-quobyte-4a78dd21-baf7-4bcc-8e78-2a86f647e179" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d04813b-de7d-4e7d-85a9-2318214083b7]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:53 devstack sudo[112439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:33:53 devstack sudo[112439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:53 devstack sudo[112439]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 0 in 0.789s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:53 devstack sudo[112443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:33:53 devstack sudo[112443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:54 devstack sudo[112443]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 1 in 0.747s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:33:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:54 devstack sudo[112448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179
Jun 24 04:33:54 devstack sudo[112448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:55 devstack sudo[112448]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-4a78dd21-baf7-4bcc-8e78-2a86f647e179" returned: 0 in 0.683s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Lock "cinder-quobyte-4a78dd21-baf7-4bcc-8e78-2a86f647e179" released by "delete_volume" :: held 2.288s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG cinder.quota [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Created reservations ['3a2ca978-245a-4ca9-bfec-d3fb086ce0ec', '9de74d4d-6fdf-4d9c-b2f7-cef916d8f749', 'c809f4da-6aa5-43cb-ae00-e670da871cf6', '87cb6ab7-ca06-4735-8dc6-2074c45fde45'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:55 devstack sudo[112451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:33:55 devstack sudo[112451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:56 devstack sudo[112451]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.721s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:56 devstack cinder-volume[93470]: DEBUG cinder.manager [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Deleted volume successfully.
Jun 24 04:33:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [req-02d977ef-7286-4af5-8f07-ab3da20fa8ec req-17ba5d18-f310-4744-b7fd-7c41aa751b5b tempest-TestShelveInstance-929814486 None] Lock "cinder-4a78dd21-baf7-4bcc-8e78-2a86f647e179-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:05 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:34:06 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:34:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-f56c49f0-e8bf-4df0-9161-e36b9c973390 req-c6a9aef4-c412-440f-b4e6-5957c843a589 tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-f56c49f0-e8bf-4df0-9161-e36b9c973390 req-c6a9aef4-c412-440f-b4e6-5957c843a589 tempest-TestStampPattern-1334218967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96dc916-2f65-4750-a906-fd2269ec216f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-f56c49f0-e8bf-4df0-9161-e36b9c973390 req-c6a9aef4-c412-440f-b4e6-5957c843a589 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:07 devstack sudo[112485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf
Jun 24 04:34:07 devstack sudo[112485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:08 devstack sudo[112485]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [req-f56c49f0-e8bf-4df0-9161-e36b9c973390 req-c6a9aef4-c412-440f-b4e6-5957c843a589 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf" returned: 0 in 0.809s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [req-f56c49f0-e8bf-4df0-9161-e36b9c973390 req-c6a9aef4-c412-440f-b4e6-5957c843a589 tempest-TestStampPattern-1334218967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.834s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:08 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-f56c49f0-e8bf-4df0-9161-e36b9c973390 req-c6a9aef4-c412-440f-b4e6-5957c843a589 tempest-TestStampPattern-1334218967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90', 'name': 'volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89f4e7cc-f353-4f68-86bc-ea39afac1a07', 'enforce_multipath': True} {{(pid=93470) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:34:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-f56c49f0-e8bf-4df0-9161-e36b9c973390 req-c6a9aef4-c412-440f-b4e6-5957c843a589 tempest-TestStampPattern-1334218967 None] attachment_update completed successfully.
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Flow 'volume_create_manager' (2553e453-ebd2-459f-967e-f8731057d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd56576a-7c5f-447b-8970-691aa143a068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd56576a-7c5f-447b-8970-691aa143a068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a80dc8ef7f64e0c951d9531bd111750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:10Z,use_quota=True,user_id='2a1ad90e58aa470faa38d950653d5eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334ffceb-1416-4c85-909d-045f6f04a0a9),volume_type_id=334ffceb-1416-4c85-909d-045f6f04a0a9)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f674f806-7f82-44d6-a3b1-71a2daef3125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f674f806-7f82-44d6-a3b1-71a2daef3125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4665cd5d-5cd6-4266-8e4c-19a64d83e810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4665cd5d-5cd6-4266-8e4c-19a64d83e810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4', 'volume_name': 'volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4', 'volume_size': 1, 'image_id': '7308a4ae-efaf-43e7-aced-dd32aac28c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7308a4ae-efaf-43e7-aced-dd32aac28c29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26337e69f74590aab52d464dc426e65f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a80dc8ef7f64e0c951d9531bd111750', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3694e5eb682ff8ebc1aa4c5f27cdf4d594541b47fa165c356a451d99065d8e1b306acfb338ef4da13be7118f36b956970e1895ec691e4c3062d1a9e858f98833', 'id': '7308a4ae-efaf-43e7-aced-dd32aac28c29', 'created_at': datetime.datetime(2026, 6, 24, 2, 34, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7308a4ae-efaf-43e7-aced-dd32aac28c29/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb6c93a2a0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba25f72-22ab-43d6-80d5-24d22e9e8077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba25f72-22ab-43d6-80d5-24d22e9e8077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2570448f-2ee8-4911-a463-b5b2d9e0d59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:10 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Volume a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4', 'volume_size': 1, 'image_id': '7308a4ae-efaf-43e7-aced-dd32aac28c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7308a4ae-efaf-43e7-aced-dd32aac28c29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26337e69f74590aab52d464dc426e65f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a80dc8ef7f64e0c951d9531bd111750', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3694e5eb682ff8ebc1aa4c5f27cdf4d594541b47fa165c356a451d99065d8e1b306acfb338ef4da13be7118f36b956970e1895ec691e4c3062d1a9e858f98833', 'id': '7308a4ae-efaf-43e7-aced-dd32aac28c29', 'created_at': datetime.datetime(2026, 6, 24, 2, 34, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7308a4ae-efaf-43e7-aced-dd32aac28c29/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb6c93a2a0>}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Trying to clone a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 from image 7308a4ae-efaf-43e7-aced-dd32aac28c29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7308a4ae-efaf-43e7-aced-dd32aac28c29', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:34:10 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Image download 0.00 MB at 0.00 MB/s
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb602ee4-d658-4fb8-9459-109c69cc7219]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:10 devstack sudo[112888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD
Jun 24 04:34:10 devstack sudo[112888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:11 devstack sudo[112888]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:11 devstack sudo[112892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD
Jun 24 04:34:11 devstack sudo[112892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:11 devstack sudo[112892]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD" returned: 1 in 0.725s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:11 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Temporary image 7308a4ae-efaf-43e7-aced-dd32aac28c29 is fetched for user 2a1ad90e58aa470faa38d950653d5eeb. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:34:12 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2b769f-ce91-49b9-9870-fa9aba33a279]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:12 devstack sudo[112898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD
Jun 24 04:34:12 devstack sudo[112898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:12 devstack sudo[112898]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD" returned: 0 in 0.716s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:12 devstack sudo[112912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD
Jun 24 04:34:12 devstack sudo[112912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:13 devstack sudo[112912]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD" returned: 1 in 0.734s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a80dc8ef7f64e0c951d9531bd111750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:10Z,use_quota=True,user_id='2a1ad90e58aa470faa38d950653d5eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334ffceb-1416-4c85-909d-045f6f04a0a9),volume_type_id=334ffceb-1416-4c85-909d-045f6f04a0a9)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Creating volume a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:13 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:34:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:13 devstack sudo[112923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 1073741824
Jun 24 04:34:13 devstack sudo[112923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:14 devstack sudo[112923]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 1073741824" returned: 0 in 0.810s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:14 devstack sudo[112929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4
Jun 24 04:34:14 devstack sudo[112929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:14 devstack cinder-volume[93470]: INFO cinder.volume.manager [req-397b0a47-dbd8-4e7f-8fdd-0fd2e36fe943 req-a6d8072e-2ebd-413b-bf2b-2a0013e30906 tempest-TestStampPattern-1334218967 None] Terminate volume connection completed successfully.
Jun 24 04:34:14 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [req-397b0a47-dbd8-4e7f-8fdd-0fd2e36fe943 req-a6d8072e-2ebd-413b-bf2b-2a0013e30906 tempest-TestStampPattern-1334218967 None] Deleting attachment 89f4e7cc-f353-4f68-86bc-ea39afac1a07. {{(pid=93470) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:34:15 devstack sudo[112929]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" returned: 0 in 0.662s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:15 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Attempting download of 7308a4ae-efaf-43e7-aced-dd32aac28c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/7308a4ae-efaf-43e7-aced-dd32aac28c29', 'metadata': {}}])) to volume a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:34:15 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e56729-cfa6-4561-8842-06eb70b01213]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7308a4ae-efaf-43e7-aced-dd32aac28c29_ix6p7hnz {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:15 devstack sudo[112962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7308a4ae-efaf-43e7-aced-dd32aac28c29_ix6p7hnz
Jun 24 04:34:15 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:15 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7308a4ae-efaf-43e7-aced-dd32aac28c29_ix6p7hnz" returned: 0 in 0.720s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7308a4ae-efaf-43e7-aced-dd32aac28c29_ix6p7hnz {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:15 devstack sudo[112966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7308a4ae-efaf-43e7-aced-dd32aac28c29_ix6p7hnz
Jun 24 04:34:15 devstack sudo[112966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:16 devstack sudo[112966]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7308a4ae-efaf-43e7-aced-dd32aac28c29_ix6p7hnz" returned: 1 in 0.709s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7308a4ae-efaf-43e7-aced-dd32aac28c29_ix6p7hnz' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f5fbcc-7427-48c0-8f6c-ed3a81049e99]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:16 devstack sudo[112971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD
Jun 24 04:34:16 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:17 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:17 devstack sudo[112977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD
Jun 24 04:34:17 devstack sudo[112977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:18 devstack sudo[112977]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD" returned: 1 in 0.770s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:18 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] 7308a4ae-efaf-43e7-aced-dd32aac28c29 was raw, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:34:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:18 devstack sudo[112982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4
Jun 24 04:34:18 devstack sudo[112982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:19 devstack sudo[112982]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" returned: 0 in 0.905s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:19 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7308a4ae-efaf-43e7-aced-dd32aac28c29_c1a5j7c6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:34:19 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Converted 0.00 MB image at 0.00 MB/s
Jun 24 04:34:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:19 devstack sudo[113026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 1G
Jun 24 04:34:19 devstack sudo[113026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:19 devstack sudo[113026]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 1G" returned: 0 in 0.752s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:19 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e2922-0182-4c1f-bc2f-3fe29368e7d1]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:19 devstack sudo[113068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4
Jun 24 04:34:19 devstack sudo[113068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:20 devstack sudo[113068]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" returned: 0 in 0.869s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:20 devstack sudo[113074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4
Jun 24 04:34:20 devstack sudo[113074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:21 devstack sudo[113074]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" returned: 1 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Downloaded image 7308a4ae-efaf-43e7-aced-dd32aac28c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/7308a4ae-efaf-43e7-aced-dd32aac28c29', 'metadata': {}}])) to volume a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Temporary image 7308a4ae-efaf-43e7-aced-dd32aac28c29 for user 2a1ad90e58aa470faa38d950653d5eeb is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Marking volume a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Copying metadata from image 7308a4ae-efaf-43e7-aced-dd32aac28c29 to a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Creating volume glance metadata for volume a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 backed by image 7308a4ae-efaf-43e7-aced-dd32aac28c29 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7308a4ae-efaf-43e7-aced-dd32aac28c29', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '26337e69f74590aab52d464dc426e65f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2570448f-2ee8-4911-a463-b5b2d9e0d59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4', 'volume_size': 1, 'image_id': '7308a4ae-efaf-43e7-aced-dd32aac28c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7308a4ae-efaf-43e7-aced-dd32aac28c29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26337e69f74590aab52d464dc426e65f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a80dc8ef7f64e0c951d9531bd111750', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3694e5eb682ff8ebc1aa4c5f27cdf4d594541b47fa165c356a451d99065d8e1b306acfb338ef4da13be7118f36b956970e1895ec691e4c3062d1a9e858f98833', 'id': '7308a4ae-efaf-43e7-aced-dd32aac28c29', 'created_at': datetime.datetime(2026, 6, 24, 2, 34, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7308a4ae-efaf-43e7-aced-dd32aac28c29/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb6c93a2a0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2524c57-0ef4-43d5-b1ba-f0a403f2835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:21 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Volume volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 (a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4): created successfully
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2524c57-0ef4-43d5-b1ba-f0a403f2835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Flow 'volume_create_manager' (2553e453-ebd2-459f-967e-f8731057d85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-caccdc13-3650-4fbf-9029-8a98317c0a45 tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Created volume successfully.
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Acquiring lock "cinder-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "cinder-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Acquiring lock "cinder-quobyte-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "cinder-quobyte-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" acquired by "delete_volume" :: waited 0.013s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67f8625-0a78-44d0-8a83-b4ad8be7f46e]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:21 devstack sudo[113079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4
Jun 24 04:34:21 devstack sudo[113079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:22 devstack sudo[113079]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" returned: 0 in 0.801s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:22 devstack sudo[113083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4
Jun 24 04:34:22 devstack sudo[113083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:23 devstack sudo[113083]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" returned: 1 in 0.776s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:23 devstack sudo[113088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4
Jun 24 04:34:23 devstack sudo[113088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-66340f2c-6294-4a2c-8895-28ec94b8b5cf-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:23 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Lock "cinder-66340f2c-6294-4a2c-8895-28ec94b8b5cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-quobyte-66340f2c-6294-4a2c-8895-28ec94b8b5cf" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-66340f2c-6294-4a2c-8895-28ec94b8b5cf" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a60cbd-dea1-4112-a512-19aabd2fc579]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:24 devstack sudo[113088]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" returned: 0 in 0.694s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "cinder-quobyte-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4" released by "delete_volume" :: held 2.344s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:24 devstack sudo[113091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf
Jun 24 04:34:24 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:24 devstack cinder-volume[93470]: WARNING cinder.quota [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:34:24 devstack cinder-volume[93470]: WARNING cinder.quota [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Created reservations ['74648737-55d8-40e6-9a4f-61bcb186c4f0', '0eba36a7-82c9-443c-a4b8-3ae188410f07', '31aac99f-a796-4f4b-9c31-40985d54cac6', 'fd9bc07e-b229-446f-bf66-842a04417aae'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:24 devstack sudo[113094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:34:24 devstack sudo[113094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:24 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf" returned: 0 in 0.776s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:24 devstack sudo[113099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf
Jun 24 04:34:24 devstack sudo[113099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:24 devstack sudo[113094]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.671s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:24 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:24 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Deleted volume successfully.
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-01892345-ec2e-4bdd-ac17-131a66c7b79d tempest-VolumeAndVolumeTypeFromImageTest-1635294394 None] Lock "cinder-a12b64e2-b9e2-4a06-81c8-a35c5c76f8e4-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:25 devstack sudo[113099]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-66340f2c-6294-4a2c-8895-28ec94b8b5cf" returned: 0 in 0.717s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-66340f2c-6294-4a2c-8895-28ec94b8b5cf" released by "delete_volume" :: held 1.532s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Created reservations ['633d6973-3e7a-4a15-a83f-b0707ff2a367', '2b1973af-edbe-43d7-bfac-42f25c0443dd', '722fc9e9-07e2-4b18-b4c2-0712c722e26a', 'e7cff5dc-98b9-4c86-a91b-8ee843770ded'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:25 devstack sudo[113103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:34:25 devstack sudo[113103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:26 devstack sudo[113103]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.770s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Deleted volume successfully.
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-fe392ebd-f870-4757-bd6f-edd055e9079a tempest-TestStampPattern-1334218967 None] Lock "cinder-66340f2c-6294-4a2c-8895-28ec94b8b5cf-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-bd40fb29-2763-47f0-b886-f4b28c52e7f1-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Lock "cinder-bd40fb29-2763-47f0-b886-f4b28c52e7f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-quobyte-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-quobyte-bd40fb29-2763-47f0-b886-f4b28c52e7f1" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-bd40fb29-2763-47f0-b886-f4b28c52e7f1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Deleting offline snapshot bd40fb29-2763-47f0-b886-f4b28c52e7f1 of volume e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] snapshot_file for this snap is: volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d4a426-1800-480f-acdf-12854c62bc7b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:26 devstack sudo[113107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1
Jun 24 04:34:26 devstack sudo[113107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:27 devstack sudo[113107]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1" returned: 0 in 0.832s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:34:27 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[17928846-e749-4428-b22b-b2dd82575ff2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:27 devstack sudo[113114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117
Jun 24 04:34:27 devstack sudo[113114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:28 devstack sudo[113114]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" returned: 0 in 0.842s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:28 devstack sudo[113119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1
Jun 24 04:34:28 devstack sudo[113119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:29 devstack sudo[113119]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1" returned: 0 in 0.724s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:29 devstack sudo[113124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1
Jun 24 04:34:29 devstack sudo[113124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:29 devstack sudo[113124]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117.bd40fb29-2763-47f0-b886-f4b28c52e7f1" returned: 0 in 0.630s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-bd40fb29-2763-47f0-b886-f4b28c52e7f1" released by "_delete_snapshot" :: held 3.139s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" released by "delete_snapshot" :: held 3.162s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:29 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Created reservations ['2fa8d2c1-e1c0-45af-89d8-fc1a51c1ac7c', 'af0b0eb3-182a-46d9-866c-39d0d5a99056', 'e5e4e1f7-6f6f-4048-93f2-c5c501a6d7a3', '1f29d57d-bd4b-4a3d-b3d7-00ce0c3324da'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:29 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Delete snapshot completed successfully.
Jun 24 04:34:29 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e1417cef-2c40-47ae-be24-1b17d0db3f78 tempest-TestStampPattern-1334218967 None] Lock "cinder-bd40fb29-2763-47f0-b886-f4b28c52e7f1-delete_snapshot" released by "delete_snapshot" :: held 3.346s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-e2f9261c-b9e2-46dd-bf3f-a7332db2b117-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Lock "cinder-e2f9261c-b9e2-46dd-bf3f-a7332db2b117-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Acquiring lock "cinder-quobyte-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:38 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:38 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[51babcff-e0a9-493a-bf56-90841d35b80b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:38 devstack sudo[113175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117
Jun 24 04:34:38 devstack sudo[113175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:39 devstack sudo[113175]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" returned: 0 in 0.745s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:39 devstack sudo[113180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117
Jun 24 04:34:39 devstack sudo[113180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:39 devstack sudo[113180]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" returned: 0 in 0.638s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Lock "cinder-quobyte-e2f9261c-b9e2-46dd-bf3f-a7332db2b117" released by "delete_volume" :: held 1.437s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Created reservations ['88604899-f685-43b2-9cea-73df4aa8100d', '051904b3-efa6-4a47-81a0-e72d58b146cf', '5ba6e86b-4b1b-4788-8730-2f7fc168ed82', 'f249c22f-489e-47dc-8adb-c48c64ad701e'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:39 devstack sudo[113183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:34:39 devstack sudo[113183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:40 devstack sudo[113183]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:40 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Deleted volume successfully.
Jun 24 04:34:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0eff3e31-55e8-4ecd-9e85-5ca85b415b82 tempest-TestStampPattern-1334218967 None] Lock "cinder-e2f9261c-b9e2-46dd-bf3f-a7332db2b117-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:45 devstack sudo[113188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:34:45 devstack sudo[113188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:45 devstack sudo[113188]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.670s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:34:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:34:49 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=38,cinder:UPDATE=34,cinder:INSERT=11 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:34:50 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=32,cinder:UPDATE=37,cinder:INSERT=16,cinder:DELETE=4 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (4488fc67-218b-4be3-98e3-8b593ec3e6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f637f7ef-f8ec-4357-9026-3cc6f84236be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f637f7ef-f8ec-4357-9026-3cc6f84236be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1270097348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df8be83-a0ca-46f8-9783-2e982f7f9118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:51Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8fca5c-bb7d-4438-bf86-c658ea44fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8fca5c-bb7d-4438-bf86-c658ea44fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247df122-7a8d-4dd0-9a73-429fdc31a539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247df122-7a8d-4dd0-9a73-429fdc31a539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3df8be83-a0ca-46f8-9783-2e982f7f9118', 'volume_name': 'volume-3df8be83-a0ca-46f8-9783-2e982f7f9118', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3311268d-187c-42c9-bf8f-27e04469fd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3311268d-187c-42c9-bf8f-27e04469fd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f0511f-6693-4716-8c2d-1b1b569bf29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:51 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume 3df8be83-a0ca-46f8-9783-2e982f7f9118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3df8be83-a0ca-46f8-9783-2e982f7f9118', 'volume_size': 1}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1270097348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df8be83-a0ca-46f8-9783-2e982f7f9118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:51Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Creating volume 3df8be83-a0ca-46f8-9783-2e982f7f9118 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:51 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:51 devstack sudo[113194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 1073741824
Jun 24 04:34:51 devstack sudo[113194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:51 devstack sudo[113194]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 1073741824" returned: 0 in 0.794s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:52 devstack sudo[113200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118
Jun 24 04:34:52 devstack sudo[113200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:52 devstack sudo[113200]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118" returned: 0 in 0.639s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f0511f-6693-4716-8c2d-1b1b569bf29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df8be83-a0ca-46f8-9783-2e982f7f9118', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0feb720-1b69-4404-ae9d-ef3bd2c8cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:52 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 (3df8be83-a0ca-46f8-9783-2e982f7f9118): created successfully
Jun 24 04:34:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0feb720-1b69-4404-ae9d-ef3bd2c8cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (4488fc67-218b-4be3-98e3-8b593ec3e6d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-45c0c2e6-8d4b-4823-b9a0-0d7e24d078a1 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created volume successfully.
Jun 24 04:34:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Creating offline snapshot d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 of volume 3df8be83-a0ca-46f8-9783-2e982f7f9118 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:34:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6e333d-01e4-4f25-b46a-8003168ce8b0]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:53 devstack sudo[113203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118
Jun 24 04:34:53 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:54 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118" returned: 0 in 0.742s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:54 devstack sudo[113208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 1G
Jun 24 04:34:54 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:54 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 1G" returned: 0 in 0.775s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:54 devstack sudo[113213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3
Jun 24 04:34:54 devstack sudo[113213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:55 devstack sudo[113213]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3" returned: 0 in 0.661s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:55 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 is being set with open permissions: ugo+rw
Jun 24 04:34:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:55 devstack sudo[113218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3
Jun 24 04:34:55 devstack sudo[113218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:56 devstack sudo[113218]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3" returned: 0 in 0.639s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:56 devstack sudo[113227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.info
Jun 24 04:34:56 devstack sudo[113227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:56 devstack sudo[113227]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.info" returned: 0 in 0.637s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:56 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.info is being set with open permissions: ugo+rw
Jun 24 04:34:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:56 devstack sudo[113231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.info
Jun 24 04:34:56 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:57 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.info" returned: 0 in 0.658s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.194s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:57 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-3d372b13-0e8f-4352-87bd-e9fcfa17918a tempest-CreateVolumesFromSnapshotTest-626859811 None] Create snapshot completed successfully
Jun 24 04:34:58 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (22fea0fe-f80b-4414-8acb-d3021f49c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38e067a-5d2b-4e5a-b685-cd5adabb80d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38e067a-5d2b-4e5a-b685-cd5adabb80d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1619654233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f686b8-6b05-4cbd-8229-1d60d426457b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:59Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844c0d09-9b22-4933-9522-fc73c5c7dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844c0d09-9b22-4933-9522-fc73c5c7dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5f2651-cda9-427f-a4c3-e76c1c0e341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5f2651-cda9-427f-a4c3-e76c1c0e341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f686b8-6b05-4cbd-8229-1d60d426457b', 'volume_name': 'volume-57f686b8-6b05-4cbd-8229-1d60d426457b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9c15aa-c5d4-429c-af9e-5d687ddfd5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9c15aa-c5d4-429c-af9e-5d687ddfd5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3969fdd6-3009-4a4e-b6af-8ba6ae1c65d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume 57f686b8-6b05-4cbd-8229-1d60d426457b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f686b8-6b05-4cbd-8229-1d60d426457b', 'volume_size': 1}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1619654233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f686b8-6b05-4cbd-8229-1d60d426457b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:59Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Creating volume 57f686b8-6b05-4cbd-8229-1d60d426457b {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:59 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:59 devstack sudo[113234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b 1073741824
Jun 24 04:34:59 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (9bc6651a-e063-47b2-ab9b-3ef836ab87ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a8ce19-64df-4a28-87c7-74f5e21e920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a8ce19-64df-4a28-87c7-74f5e21e920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-971365984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fbac7b-88fc-4b0c-8226-34a0758851e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:59Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7e394a-1022-4c00-b913-f5b9e1c33102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7e394a-1022-4c00-b913-f5b9e1c33102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617b870f-143e-4b33-a9b7-a181ae14cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617b870f-143e-4b33-a9b7-a181ae14cda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00fbac7b-88fc-4b0c-8226-34a0758851e7', 'volume_name': 'volume-00fbac7b-88fc-4b0c-8226-34a0758851e7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296a346f-a6b9-48a1-bf99-2f7447742692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296a346f-a6b9-48a1-bf99-2f7447742692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8c9f16-33c2-4aba-8912-b91aa13bba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume 00fbac7b-88fc-4b0c-8226-34a0758851e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00fbac7b-88fc-4b0c-8226-34a0758851e7', 'volume_size': 1}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (97a57b0d-1cc7-41fb-9ddf-ecd280db0c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71137b01-e593-4740-86f2-941447bfec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71137b01-e593-4740-86f2-941447bfec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096049403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:00Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbdbc4a-a500-40b8-9248-9f25978665f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbdbc4a-a500-40b8-9248-9f25978665f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38efd7b5-b084-41a3-bdc4-5e9bcf89a18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38efd7b5-b084-41a3-bdc4-5e9bcf89a18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1', 'volume_name': 'volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3f95f1-5e64-47eb-9021-af020a700430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3f95f1-5e64-47eb-9021-af020a700430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b43d16-0129-4a0f-8862-24a87a3e4fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:59 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume 1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1', 'volume_size': 1}
Jun 24 04:34:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:00 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b 1073741824" returned: 0 in 0.936s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:00 devstack sudo[113240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b
Jun 24 04:35:00 devstack sudo[113240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (926c3e32-69f9-46cf-b42d-76cfabc51aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8a30cc-c108-4653-a6e1-e94e10c78443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8a30cc-c108-4653-a6e1-e94e10c78443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261340365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e447d-b96d-4a62-9679-f4c070a2a877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:00Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6568cdba-9784-43c4-a569-44596809a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6568cdba-9784-43c4-a569-44596809a21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a883ab04-572f-4baf-8ba6-66743c4592a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a883ab04-572f-4baf-8ba6-66743c4592a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9e447d-b96d-4a62-9679-f4c070a2a877', 'volume_name': 'volume-9a9e447d-b96d-4a62-9679-f4c070a2a877', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77ad453-1a52-4dbe-b084-29b086cf2668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77ad453-1a52-4dbe-b084-29b086cf2668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a5db60-74dd-4363-916a-05f2146d8911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume 9a9e447d-b96d-4a62-9679-f4c070a2a877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9e447d-b96d-4a62-9679-f4c070a2a877', 'volume_size': 1}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (b918b089-427e-4a61-b6ef-17430efff1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb12c86-0b0f-454a-886e-189b986806e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb12c86-0b0f-454a-886e-189b986806e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36561326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18224869-ef51-43f6-b901-3d55786a760c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:01Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a584c64-a902-434d-b71c-6f701c30965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a584c64-a902-434d-b71c-6f701c30965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabd076f-af22-4eaa-967d-e3898afceb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabd076f-af22-4eaa-967d-e3898afceb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18224869-ef51-43f6-b901-3d55786a760c', 'volume_name': 'volume-18224869-ef51-43f6-b901-3d55786a760c', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2976b5-99e3-461c-84bc-2fbfc369cdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2976b5-99e3-461c-84bc-2fbfc369cdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2093e5-a5ea-46b2-a18c-730bc216d7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume 18224869-ef51-43f6-b901-3d55786a760c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18224869-ef51-43f6-b901-3d55786a760c', 'volume_size': 1}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:00 devstack sudo[113240]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b" returned: 0 in 0.699s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.304s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-971365984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fbac7b-88fc-4b0c-8226-34a0758851e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:59Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Creating volume 00fbac7b-88fc-4b0c-8226-34a0758851e7 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:35:00 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3969fdd6-3009-4a4e-b6af-8ba6ae1c65d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f686b8-6b05-4cbd-8229-1d60d426457b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack sudo[113243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7 1073741824
Jun 24 04:35:00 devstack sudo[113243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bb9b0f-afa6-47dc-b099-5bd0753446e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:00 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume volume-57f686b8-6b05-4cbd-8229-1d60d426457b (57f686b8-6b05-4cbd-8229-1d60d426457b): created successfully
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bb9b0f-afa6-47dc-b099-5bd0753446e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:00 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (22fea0fe-f80b-4414-8acb-d3021f49c908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ddc5e74c-53ab-45d6-8f7c-b57c2d74e9ef tempest-CreateVolumesFromSnapshotTest-626859811 None] Created volume successfully.
Jun 24 04:35:01 devstack sudo[113243]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7 1073741824" returned: 0 in 0.841s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:01 devstack sudo[113252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7
Jun 24 04:35:01 devstack sudo[113252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:02 devstack sudo[113252]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7" returned: 0 in 0.678s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.515s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096049403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:00Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Creating volume 1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:35:02 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8c9f16-33c2-4aba-8912-b91aa13bba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00fbac7b-88fc-4b0c-8226-34a0758851e7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:02 devstack sudo[113257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1 1073741824
Jun 24 04:35:02 devstack sudo[113257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5102f7-7244-4cbc-a739-88bdbf43ba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:02 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume volume-00fbac7b-88fc-4b0c-8226-34a0758851e7 (00fbac7b-88fc-4b0c-8226-34a0758851e7): created successfully
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5102f7-7244-4cbc-a739-88bdbf43ba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (9bc6651a-e063-47b2-ab9b-3ef836ab87ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:02 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-89112172-7223-4676-b3f2-c57b17395796 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created volume successfully.
Jun 24 04:35:03 devstack sudo[113257]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1 1073741824" returned: 0 in 0.848s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:03 devstack sudo[113263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1
Jun 24 04:35:03 devstack sudo[113263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:03 devstack sudo[113263]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1" returned: 0 in 0.654s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.648s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261340365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e447d-b96d-4a62-9679-f4c070a2a877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:00Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Creating volume 9a9e447d-b96d-4a62-9679-f4c070a2a877 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:35:03 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:03 devstack sudo[113266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877 1073741824
Jun 24 04:35:03 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b43d16-0129-4a0f-8862-24a87a3e4fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64b9f98-2327-4069-9471-8a511dca2a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:03 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1 (1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1): created successfully
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64b9f98-2327-4069-9471-8a511dca2a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:03 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (97a57b0d-1cc7-41fb-9ddf-ecd280db0c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:03 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-433859be-9770-41e2-8be2-0d5b8772605b tempest-CreateVolumesFromSnapshotTest-626859811 None] Created volume successfully.
Jun 24 04:35:04 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877 1073741824" returned: 0 in 0.784s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:04 devstack sudo[113271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877
Jun 24 04:35:04 devstack sudo[113271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:05 devstack sudo[113271]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877" returned: 0 in 0.630s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.606s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36561326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18224869-ef51-43f6-b901-3d55786a760c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b125ee4802e4c8c9c3e899b3686cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:01Z,use_quota=True,user_id='f98c10bb2cdf46f4a333df253fd35d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Creating volume 18224869-ef51-43f6-b901-3d55786a760c {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:35:05 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a5db60-74dd-4363-916a-05f2146d8911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9e447d-b96d-4a62-9679-f4c070a2a877', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:05 devstack sudo[113276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c 1073741824
Jun 24 04:35:05 devstack sudo[113276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6159455c-b26e-4d0b-a0db-64598098c54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:05 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume volume-9a9e447d-b96d-4a62-9679-f4c070a2a877 (9a9e447d-b96d-4a62-9679-f4c070a2a877): created successfully
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6159455c-b26e-4d0b-a0db-64598098c54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (926c3e32-69f9-46cf-b42d-76cfabc51aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:05 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-70a064a5-c179-44f8-8dae-1df5655e8501 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created volume successfully.
Jun 24 04:35:06 devstack sudo[113276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c 1073741824" returned: 0 in 0.822s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:06 devstack sudo[113282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c
Jun 24 04:35:06 devstack sudo[113282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:06 devstack sudo[113282]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c" returned: 0 in 0.636s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2093e5-a5ea-46b2-a18c-730bc216d7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18224869-ef51-43f6-b901-3d55786a760c', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceb97d3-3cb8-4bc4-bf28-975d9897520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:06 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Volume volume-18224869-ef51-43f6-b901-3d55786a760c (18224869-ef51-43f6-b901-3d55786a760c): created successfully
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceb97d3-3cb8-4bc4-bf28-975d9897520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Flow 'volume_create_manager' (b918b089-427e-4a61-b6ef-17430efff1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-82477484-2e72-4ff2-81ad-b7072f81f863 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created volume successfully.
Jun 24 04:35:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-18224869-ef51-43f6-b901-3d55786a760c-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-18224869-ef51-43f6-b901-3d55786a760c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-quobyte-18224869-ef51-43f6-b901-3d55786a760c" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-18224869-ef51-43f6-b901-3d55786a760c" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3475ea27-0932-4251-a5d9-d5c6b396ed75]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:07 devstack sudo[113286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c
Jun 24 04:35:07 devstack sudo[113286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:07 devstack sudo[113286]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c" returned: 0 in 0.749s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:07 devstack sudo[113293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c
Jun 24 04:35:07 devstack sudo[113293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:08 devstack sudo[113293]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-18224869-ef51-43f6-b901-3d55786a760c" returned: 0 in 0.642s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-18224869-ef51-43f6-b901-3d55786a760c" released by "delete_volume" :: held 1.429s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created reservations ['725604ed-24ad-48bb-b192-13f5d9613cd0', '88b624e5-4478-434b-bbe0-2bee9cfee2b7', '4a5ed273-7224-4026-ad4a-c8f11fc38603', '4a6e5273-299d-4799-8dca-9a5c51944c2e'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:08 devstack sudo[113296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:08 devstack sudo[113296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-9a9e447d-b96d-4a62-9679-f4c070a2a877-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-9a9e447d-b96d-4a62-9679-f4c070a2a877-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:09 devstack sudo[113296]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.662s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:09 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Deleted volume successfully.
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-quobyte-9a9e447d-b96d-4a62-9679-f4c070a2a877" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-58fe50ea-084e-4bd5-a53d-a69ceaa35894 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-18224869-ef51-43f6-b901-3d55786a760c-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-9a9e447d-b96d-4a62-9679-f4c070a2a877" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d810f265-f1da-434d-92bf-0617a38e0189]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:09 devstack sudo[113299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877
Jun 24 04:35:09 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:10 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877" returned: 0 in 0.743s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:10 devstack sudo[113304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877
Jun 24 04:35:10 devstack sudo[113304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:10 devstack sudo[113304]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-9a9e447d-b96d-4a62-9679-f4c070a2a877" returned: 0 in 0.656s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-9a9e447d-b96d-4a62-9679-f4c070a2a877" released by "delete_volume" :: held 1.436s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created reservations ['ef6332cf-567a-4027-b7ea-bc2835373612', 'df839157-1132-4ab6-b9d5-361925023848', '2cb7a8a9-752b-4892-abbb-9e3760f68943', '322e1c57-8b9a-4a47-8407-1096da4231d7'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:10 devstack sudo[113307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:10 devstack sudo[113307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:11 devstack sudo[113307]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.640s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:11 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Deleted volume successfully.
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-quobyte-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6e9d0300-0943-4fde-8461-9364326b7559 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-9a9e447d-b96d-4a62-9679-f4c070a2a877-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a8e4fa-1735-4f97-9671-e9723b1850f0]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:11 devstack sudo[113311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1
Jun 24 04:35:11 devstack sudo[113311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:12 devstack sudo[113311]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1" returned: 0 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:12 devstack sudo[113316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1
Jun 24 04:35:12 devstack sudo[113316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:13 devstack sudo[113316]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1" returned: 0 in 0.633s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1" released by "delete_volume" :: held 1.431s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Created reservations ['bbc70342-45c9-4d00-9ddd-4ade36b2354b', '4e9e8217-385f-40fc-9a35-bdc17d9c1dee', '336df94f-4bd7-43d0-922d-38e369c3d770', '394fea23-0220-43ea-abab-d9872cb6b466'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:13 devstack sudo[113319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:13 devstack sudo[113319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-00fbac7b-88fc-4b0c-8226-34a0758851e7-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-00fbac7b-88fc-4b0c-8226-34a0758851e7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:13 devstack sudo[113319]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-quobyte-00fbac7b-88fc-4b0c-8226-34a0758851e7" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.675s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:13 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Deleted volume successfully.
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-00fbac7b-88fc-4b0c-8226-34a0758851e7" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6a47cabd-dca2-4dab-b77a-e4711d3ba47f tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-1c98047a-7b8e-48be-b4e2-c8fdcf3e71e1-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf907c7-1c00-4687-9885-bcde4c5882ba]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:14 devstack sudo[113322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7
Jun 24 04:35:14 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:14 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7" returned: 0 in 0.758s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:14 devstack sudo[113327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7
Jun 24 04:35:14 devstack sudo[113327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:15 devstack sudo[113327]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-00fbac7b-88fc-4b0c-8226-34a0758851e7" returned: 0 in 0.644s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-00fbac7b-88fc-4b0c-8226-34a0758851e7" released by "delete_volume" :: held 1.447s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created reservations ['95831dcb-defb-4680-9e7c-075ad999fdc1', 'a473c06e-bb7e-4c95-a71a-d976beca4675', 'c52e9fce-0f74-4945-99b0-66a8378f8b15', 'a6df14d2-084a-4bb5-aba3-2f0b44029c4f'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:15 devstack sudo[113330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:15 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-57f686b8-6b05-4cbd-8229-1d60d426457b-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-57f686b8-6b05-4cbd-8229-1d60d426457b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:16 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.647s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:16 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Deleted volume successfully.
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-quobyte-57f686b8-6b05-4cbd-8229-1d60d426457b" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d0d262d-58de-42cb-b1d1-83fcacb8ba00 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-00fbac7b-88fc-4b0c-8226-34a0758851e7-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-57f686b8-6b05-4cbd-8229-1d60d426457b" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dd943b-ced4-466e-b42f-0d60fedd28a5]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:16 devstack sudo[113333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b
Jun 24 04:35:16 devstack sudo[113333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:16 devstack sudo[113333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b" returned: 0 in 0.733s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:16 devstack sudo[113339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b
Jun 24 04:35:16 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:17 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-57f686b8-6b05-4cbd-8229-1d60d426457b" returned: 0 in 0.651s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-57f686b8-6b05-4cbd-8229-1d60d426457b" released by "delete_volume" :: held 1.423s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created reservations ['89d3e10e-9e07-4ddf-809f-2e15e1052f5d', 'ff373ce2-ab41-4deb-a24d-0a6532934381', '73c4836e-3ec6-48eb-8c81-8e66028a74d4', '19c6bbc2-2671-4f53-bec9-fceda37387b3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:17 devstack sudo[113342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:17 devstack sudo[113342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-d909d477-ec78-4b4c-bd01-4a6b6aa21ee3-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-d909d477-ec78-4b4c-bd01-4a6b6aa21ee3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-quobyte-3df8be83-a0ca-46f8-9783-2e982f7f9118" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-3df8be83-a0ca-46f8-9783-2e982f7f9118" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-quobyte-d909d477-ec78-4b4c-bd01-4a6b6aa21ee3" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:18 devstack sudo[113342]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.643s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-d909d477-ec78-4b4c-bd01-4a6b6aa21ee3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Deleting offline snapshot d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 of volume 3df8be83-a0ca-46f8-9783-2e982f7f9118 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] snapshot_file for this snap is: volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:35:18 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Deleted volume successfully.
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb1fff3-973e-4137-a6f7-0c9138905a23]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-048d79f7-3d89-42cd-8199-0cf9c05aef98 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-57f686b8-6b05-4cbd-8229-1d60d426457b-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:18 devstack sudo[113345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3
Jun 24 04:35:18 devstack sudo[113345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:19 devstack sudo[113345]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3" returned: 0 in 0.792s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3df8be83-a0ca-46f8-9783-2e982f7f9118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:35:19 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aedf63-1eb0-471e-906e-868b6468851c]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:19 devstack sudo[113350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118
Jun 24 04:35:19 devstack sudo[113350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:19 devstack sudo[113350]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118" returned: 0 in 0.784s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:20 devstack sudo[113391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3
Jun 24 04:35:20 devstack sudo[113391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:20 devstack sudo[113391]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3" returned: 0 in 0.777s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:20 devstack sudo[113396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3
Jun 24 04:35:20 devstack sudo[113396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:21 devstack sudo[113396]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118.d909d477-ec78-4b4c-bd01-4a6b6aa21ee3" returned: 0 in 0.647s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-d909d477-ec78-4b4c-bd01-4a6b6aa21ee3" released by "_delete_snapshot" :: held 3.126s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-3df8be83-a0ca-46f8-9783-2e982f7f9118" released by "delete_snapshot" :: held 3.153s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:21 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Created reservations ['3b783687-3dde-46c0-8416-3c64d8d1c848', 'c157a7bd-9bac-4045-96a2-6799f1fee28f', '333f856a-065e-4b52-995d-260ea606b653', 'a73d6ead-8ede-4d43-bbc4-1c2eda339dda'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Delete snapshot completed successfully.
Jun 24 04:35:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d5fe200a-0898-4184-bf03-84b40e1bd4b0 tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-d909d477-ec78-4b4c-bd01-4a6b6aa21ee3-delete_snapshot" released by "delete_snapshot" :: held 3.279s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-3df8be83-a0ca-46f8-9783-2e982f7f9118-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-3df8be83-a0ca-46f8-9783-2e982f7f9118-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "cinder-quobyte-3df8be83-a0ca-46f8-9783-2e982f7f9118" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-3df8be83-a0ca-46f8-9783-2e982f7f9118" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc185bfd-f212-4973-be4a-84dd65ce8002]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:22 devstack sudo[113399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118
Jun 24 04:35:22 devstack sudo[113399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:23 devstack sudo[113399]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118" returned: 0 in 0.765s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:23 devstack sudo[113404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118
Jun 24 04:35:23 devstack sudo[113404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:24 devstack sudo[113404]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3df8be83-a0ca-46f8-9783-2e982f7f9118" returned: 0 in 0.652s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-quobyte-3df8be83-a0ca-46f8-9783-2e982f7f9118" released by "delete_volume" :: held 1.477s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Created reservations ['59e70ee2-d2e2-45c3-9fe7-cc5334bdf824', '1464aff9-8be5-48ca-a9d7-9bf635103de4', 'a22dead2-bdfc-4535-9892-c26d344ae192', '2fc9575b-4542-401e-b6b3-f282bdb052ff'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:24 devstack sudo[113407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:24 devstack sudo[113407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:24 devstack sudo[113407]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.633s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:24 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Deleted volume successfully.
Jun 24 04:35:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-e5aa3a8f-fff1-4c1c-a89d-bea3949ab81b tempest-CreateVolumesFromSnapshotTest-626859811 None] Lock "cinder-3df8be83-a0ca-46f8-9783-2e982f7f9118-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Flow 'volume_create_manager' (13ed150c-7bcb-4465-b260-e76f8dd65e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c55508-b884-48e3-bb80-85d40e81a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c55508-b884-48e3-bb80-85d40e81a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-758682075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc27873-9456-4055-993d-d06fac9dc65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71562cb7a8a440bf905742ff161bd5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:27Z,use_quota=True,user_id='a66ff7c405334eb788321e596464c7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6b5164-0ed2-4f61-9fde-73325a8db3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6b5164-0ed2-4f61-9fde-73325a8db3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d91286f-bf36-43ad-aae4-e00fb4c9db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d91286f-bf36-43ad-aae4-e00fb4c9db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cc27873-9456-4055-993d-d06fac9dc65b', 'volume_name': 'volume-5cc27873-9456-4055-993d-d06fac9dc65b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b93608-f81c-40cc-91d3-b3c5c3299edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b93608-f81c-40cc-91d3-b3c5c3299edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4cfb3f-f51a-4748-9cb1-6771c5f30e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:27 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Volume 5cc27873-9456-4055-993d-d06fac9dc65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cc27873-9456-4055-993d-d06fac9dc65b', 'volume_size': 1}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-758682075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc27873-9456-4055-993d-d06fac9dc65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71562cb7a8a440bf905742ff161bd5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:27Z,use_quota=True,user_id='a66ff7c405334eb788321e596464c7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Creating volume 5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:35:27 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:35:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:27 devstack sudo[113412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b 1073741824
Jun 24 04:35:27 devstack sudo[113412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:28 devstack sudo[113412]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b 1073741824" returned: 0 in 0.847s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:28 devstack sudo[113418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b
Jun 24 04:35:28 devstack sudo[113418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:28 devstack sudo[113418]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b" returned: 0 in 0.643s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4cfb3f-f51a-4748-9cb1-6771c5f30e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc27873-9456-4055-993d-d06fac9dc65b', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50c8323-1478-4b59-93a9-c271f523f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:29 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Volume volume-5cc27873-9456-4055-993d-d06fac9dc65b (5cc27873-9456-4055-993d-d06fac9dc65b): created successfully
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50c8323-1478-4b59-93a9-c271f523f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Flow 'volume_create_manager' (13ed150c-7bcb-4465-b260-e76f8dd65e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:29 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fd7f1256-0a15-48b3-81cd-c19b7c1faa0d tempest-VolumeDependencyTests-1358139451 None] Created volume successfully.
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Creating offline snapshot 7d754a96-4a1c-4114-8b94-893db8006eda of volume 5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6623b1-48ab-46e2-862d-6a65b4ed1a6e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:29 devstack sudo[113421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b
Jun 24 04:35:29 devstack sudo[113421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:30 devstack sudo[113421]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:30 devstack sudo[113426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda 1G
Jun 24 04:35:30 devstack sudo[113426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:31 devstack sudo[113426]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda 1G" returned: 0 in 0.851s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cc27873-9456-4055-993d-d06fac9dc65b -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:31 devstack sudo[113432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cc27873-9456-4055-993d-d06fac9dc65b -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda
Jun 24 04:35:31 devstack sudo[113432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:31 devstack sudo[113432]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cc27873-9456-4055-993d-d06fac9dc65b -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda" returned: 0 in 0.692s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:31 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda is being set with open permissions: ugo+rw
Jun 24 04:35:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:31 devstack sudo[113437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda
Jun 24 04:35:31 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:32 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda" returned: 0 in 0.651s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:32 devstack sudo[113440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.info
Jun 24 04:35:32 devstack sudo[113440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:33 devstack sudo[113440]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.info" returned: 0 in 0.687s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:33 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.info is being set with open permissions: ugo+rw
Jun 24 04:35:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:33 devstack sudo[113443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.info
Jun 24 04:35:33 devstack sudo[113443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:34 devstack sudo[113443]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.info" returned: 0 in 0.685s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.402s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:34 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-57589646-ce71-489a-8724-57696d02608c tempest-VolumeDependencyTests-1358139451 None] Create snapshot completed successfully
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Flow 'volume_create_manager' (f2931ee6-e1da-4fd7-af86-24463e9d5c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b8038f-1a3f-4cd3-8397-9d340a706c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b8038f-1a3f-4cd3-8397-9d340a706c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1874223145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb72fcdf-c6f2-4357-b4ee-539178eb737a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71562cb7a8a440bf905742ff161bd5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d754a96-4a1c-4114-8b94-893db8006eda,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:35Z,use_quota=True,user_id='a66ff7c405334eb788321e596464c7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fd9b32-2a7a-43c1-8192-ef24dd8b4918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fd9b32-2a7a-43c1-8192-ef24dd8b4918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f32e8a-6fa9-4ea5-8b78-d10dc03efda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f32e8a-6fa9-4ea5-8b78-d10dc03efda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb72fcdf-c6f2-4357-b4ee-539178eb737a', 'volume_name': 'volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a', 'volume_size': 1, 'snapshot_id': '7d754a96-4a1c-4114-8b94-893db8006eda'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1d93e3-7788-4681-be8e-ec9b28adf548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1d93e3-7788-4681-be8e-ec9b28adf548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9de0a51-b59b-4967-9949-d7347fc458a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:35 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Volume cb72fcdf-c6f2-4357-b4ee-539178eb737a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a', 'volume_size': 1, 'snapshot_id': '7d754a96-4a1c-4114-8b94-893db8006eda'}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-quobyte-7d754a96-4a1c-4114-8b94-893db8006eda-cb72fcdf-c6f2-4357-b4ee-539178eb737a" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-7d754a96-4a1c-4114-8b94-893db8006eda-cb72fcdf-c6f2-4357-b4ee-539178eb737a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Creating volume cb72fcdf-c6f2-4357-b4ee-539178eb737a from snapshot 7d754a96-4a1c-4114-8b94-893db8006eda {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-quobyte-cb72fcdf-c6f2-4357-b4ee-539178eb737a" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-cb72fcdf-c6f2-4357-b4ee-539178eb737a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] snapshot: 7d754a96-4a1c-4114-8b94-893db8006eda, volume: cb72fcdf-c6f2-4357-b4ee-539178eb737a,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[59581f12-685b-464b-aac2-90364025e4d0]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:35 devstack sudo[113446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda
Jun 24 04:35:35 devstack sudo[113446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:36 devstack sudo[113446]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda" returned: 0 in 0.766s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cc27873-9456-4055-993d-d06fac9dc65b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:35:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:35:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:35:36 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a168109b-ce8c-4265-b461-57664e876ebc]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:36 devstack sudo[113451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b
Jun 24 04:35:36 devstack sudo[113451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:37 devstack sudo[113451]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b" returned: 0 in 0.747s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:37 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:35:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:37 devstack sudo[113457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a
Jun 24 04:35:37 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:41 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a" returned: 0 in 4.275s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:41 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[722a0332-148f-4b8a-b1a7-0e42249d9c77]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:41 devstack sudo[113470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b
Jun 24 04:35:41 devstack sudo[113470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:42 devstack sudo[113470]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b" returned: 0 in 0.899s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:35:42 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Converted 1024.00 MB image at 239.46 MB/s
Jun 24 04:35:42 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a is being set with open permissions: ugo+rw
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:42 devstack sudo[113475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a
Jun 24 04:35:42 devstack sudo[113475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:42 devstack sudo[113475]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a" returned: 0 in 0.643s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-cb72fcdf-c6f2-4357-b4ee-539178eb737a" released by "_copy_volume_from_snapshot" :: held 7.420s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-7d754a96-4a1c-4114-8b94-893db8006eda-cb72fcdf-c6f2-4357-b4ee-539178eb737a" released by "_create_volume_from_snapshot" :: held 7.455s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.470s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9de0a51-b59b-4967-9949-d7347fc458a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a', 'volume_size': 1, 'snapshot_id': '7d754a96-4a1c-4114-8b94-893db8006eda'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b7e97f-0b87-4d3b-8584-d268804c51cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:42 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Volume volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a (cb72fcdf-c6f2-4357-b4ee-539178eb737a): created successfully
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b7e97f-0b87-4d3b-8584-d268804c51cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Flow 'volume_create_manager' (f2931ee6-e1da-4fd7-af86-24463e9d5c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1b009639-dc21-4ef7-b4d8-fc2067af20f0 tempest-VolumeDependencyTests-1358139451 None] Created volume successfully.
Jun 24 04:35:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-7d754a96-4a1c-4114-8b94-893db8006eda-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-7d754a96-4a1c-4114-8b94-893db8006eda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-quobyte-5cc27873-9456-4055-993d-d06fac9dc65b" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-5cc27873-9456-4055-993d-d06fac9dc65b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-quobyte-7d754a96-4a1c-4114-8b94-893db8006eda" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:43 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-7d754a96-4a1c-4114-8b94-893db8006eda" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Deleting offline snapshot 7d754a96-4a1c-4114-8b94-893db8006eda of volume 5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:35:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] snapshot_file for this snap is: volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:35:44 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7feb83-337a-4851-a842-24e58121eff0]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:44 devstack sudo[113478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda
Jun 24 04:35:44 devstack sudo[113478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:44 devstack sudo[113478]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda" returned: 0 in 0.725s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cc27873-9456-4055-993d-d06fac9dc65b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:35:44 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[798740e8-317f-4f7e-9066-1edaf511f3e9]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:44 devstack sudo[113483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b
Jun 24 04:35:44 devstack sudo[113483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:45 devstack sudo[113485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:45 devstack sudo[113485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:45 devstack sudo[113483]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b" returned: 0 in 0.755s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:45 devstack sudo[113490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda
Jun 24 04:35:45 devstack sudo[113490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:45 devstack sudo[113485]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.668s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:35:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:35:46 devstack sudo[113490]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda" returned: 0 in 0.715s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:46 devstack sudo[113496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda
Jun 24 04:35:46 devstack sudo[113496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:46 devstack sudo[113496]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b.7d754a96-4a1c-4114-8b94-893db8006eda" returned: 0 in 0.616s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-7d754a96-4a1c-4114-8b94-893db8006eda" released by "_delete_snapshot" :: held 2.901s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-5cc27873-9456-4055-993d-d06fac9dc65b" released by "delete_snapshot" :: held 2.921s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:46 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Created reservations ['7ed8b982-0846-4af6-8c51-11efadf8ed9d', 'a04e0f44-cfb1-41bb-87e1-1cb577940b3e', 'ac4f2485-822d-4ca5-aacf-41ee1adafe7c', '11213829-af34-45f2-83ef-c8f081611740'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Delete snapshot completed successfully.
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2dfaea63-43f0-431e-b385-a7e4dad250e3 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-7d754a96-4a1c-4114-8b94-893db8006eda-delete_snapshot" released by "delete_snapshot" :: held 3.046s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-5cc27873-9456-4055-993d-d06fac9dc65b-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-5cc27873-9456-4055-993d-d06fac9dc65b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-quobyte-5cc27873-9456-4055-993d-d06fac9dc65b" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-5cc27873-9456-4055-993d-d06fac9dc65b" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3badc2d0-e734-4af3-b84a-3fed0d7d35e1]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:47 devstack sudo[113500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b
Jun 24 04:35:47 devstack sudo[113500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:47 devstack sudo[113500]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b" returned: 0 in 0.743s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:47 devstack sudo[113505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b
Jun 24 04:35:47 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:48 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-5cc27873-9456-4055-993d-d06fac9dc65b" returned: 0 in 0.673s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-5cc27873-9456-4055-993d-d06fac9dc65b" released by "delete_volume" :: held 1.476s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Created reservations ['8f81562b-627b-409a-9e77-1e0d5a7318d3', 'e5af1402-c7f7-4106-bda9-a07de0b2c8ea', 'ca0c1538-782b-465c-922d-4652d9031a99', '79636403-a471-4886-8b60-310a0ae27733'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:48 devstack sudo[113508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:48 devstack sudo[113508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-cb72fcdf-c6f2-4357-b4ee-539178eb737a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-cb72fcdf-c6f2-4357-b4ee-539178eb737a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "cinder-quobyte-cb72fcdf-c6f2-4357-b4ee-539178eb737a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-cb72fcdf-c6f2-4357-b4ee-539178eb737a" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:49 devstack sudo[113508]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb059c2d-75a9-4726-997b-5dfb7f6f59ff]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.678s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Deleted volume successfully.
Jun 24 04:35:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e8a67f5-2736-4da8-82b9-7e7329abb3e7 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-5cc27873-9456-4055-993d-d06fac9dc65b-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:49 devstack sudo[113511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a
Jun 24 04:35:49 devstack sudo[113511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:50 devstack sudo[113511]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a" returned: 0 in 0.744s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:50 devstack sudo[113516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a
Jun 24 04:35:50 devstack sudo[113516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=74,cinder:UPDATE=92,cinder:INSERT=23,cinder:DELETE=7 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:35:50 devstack sudo[113516]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-cb72fcdf-c6f2-4357-b4ee-539178eb737a" returned: 0 in 0.621s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-quobyte-cb72fcdf-c6f2-4357-b4ee-539178eb737a" released by "delete_volume" :: held 1.406s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=96,cinder:SELECT=69,cinder:INSERT=22,cinder:DELETE=10 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Created reservations ['68d3ea6b-c1c7-4ab8-be87-82bf61c10dd7', '514fa16a-8276-42fb-a56c-39e9aab577ee', 'f81b8bfe-3504-49ca-a159-a3efab27c2ac', 'b382e573-1ec8-4f50-9f13-b3fd8cc160fc'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:50 devstack sudo[113519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:35:50 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:51 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.629s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:51 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Deleted volume successfully.
Jun 24 04:35:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a03936f7-fdbf-4c31-b30d-c11a8972dfb8 tempest-VolumeDependencyTests-1358139451 None] Lock "cinder-cb72fcdf-c6f2-4357-b4ee-539178eb737a-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Flow 'volume_create_manager' (8d6d9041-ec53-43eb-b594-73e69f512be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64aadaa5-241e-468e-8cca-7ab7627bb90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64aadaa5-241e-468e-8cca-7ab7627bb90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1477f502-ab4c-49f6-a4e5-e345cbd6b413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9886c3d50d3643c1bae6a108682b687e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:56Z,use_quota=True,user_id='c444e8f2ea0e48d29541f77abb2e6d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437f06fb-7088-4253-bd59-9b69bd2bf1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437f06fb-7088-4253-bd59-9b69bd2bf1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5334c906-725b-4a9f-9b1a-8d1ecfac0453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5334c906-725b-4a9f-9b1a-8d1ecfac0453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1477f502-ab4c-49f6-a4e5-e345cbd6b413', 'volume_name': 'volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413', 'volume_size': 1, 'image_id': 'b2f74277-3203-4dd2-8bc4-719d19ecea05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f74277-3203-4dd2-8bc4-719d19ecea05', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8012fd8a21f4fcb40c5d530acd88d944', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9886c3d50d3643c1bae6a108682b687e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65e47d5b6839c36557847a237c67ab106a363e0a8633f5de53df85121a7bea815b26632cf45bdaf6197101d075123a55d2219023411e63e5bd96de306c181de6', 'id': 'b2f74277-3203-4dd2-8bc4-719d19ecea05', 'created_at': datetime.datetime(2026, 6, 24, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f74277-3203-4dd2-8bc4-719d19ecea05/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76b090d0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e4ab12-a080-4661-9177-8a6580d05326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e4ab12-a080-4661-9177-8a6580d05326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18e23b2-3547-4a85-8eb0-bd402a7960cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:56 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Volume 1477f502-ab4c-49f6-a4e5-e345cbd6b413: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413', 'volume_size': 1, 'image_id': 'b2f74277-3203-4dd2-8bc4-719d19ecea05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f74277-3203-4dd2-8bc4-719d19ecea05', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8012fd8a21f4fcb40c5d530acd88d944', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9886c3d50d3643c1bae6a108682b687e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65e47d5b6839c36557847a237c67ab106a363e0a8633f5de53df85121a7bea815b26632cf45bdaf6197101d075123a55d2219023411e63e5bd96de306c181de6', 'id': 'b2f74277-3203-4dd2-8bc4-719d19ecea05', 'created_at': datetime.datetime(2026, 6, 24, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f74277-3203-4dd2-8bc4-719d19ecea05/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76b090d0>}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Trying to clone 1477f502-ab4c-49f6-a4e5-e345cbd6b413 from image b2f74277-3203-4dd2-8bc4-719d19ecea05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2f74277-3203-4dd2-8bc4-719d19ecea05', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:35:56 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Image download 0.00 MB at 0.00 MB/s
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db1161a-7943-4962-b380-f4f668e8245c]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:56 devstack sudo[113529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD
Jun 24 04:35:56 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:57 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:57 devstack sudo[113533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD
Jun 24 04:35:57 devstack sudo[113533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:58 devstack sudo[113533]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD" returned: 1 in 0.710s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:35:58 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Temporary image b2f74277-3203-4dd2-8bc4-719d19ecea05 is fetched for user c444e8f2ea0e48d29541f77abb2e6d38. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:35:58 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ed7e1-5983-49a1-a1ac-e841e08236d9]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:58 devstack sudo[113538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD
Jun 24 04:35:58 devstack sudo[113538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:58 devstack sudo[113538]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD" returned: 0 in 0.696s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:58 devstack sudo[113542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD
Jun 24 04:35:58 devstack sudo[113542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:59 devstack sudo[113542]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD" returned: 1 in 0.720s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1477f502-ab4c-49f6-a4e5-e345cbd6b413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9886c3d50d3643c1bae6a108682b687e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:35:56Z,use_quota=True,user_id='c444e8f2ea0e48d29541f77abb2e6d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Creating volume 1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:35:59 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:35:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:59 devstack sudo[113547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 1073741824
Jun 24 04:35:59 devstack sudo[113547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:00 devstack sudo[113547]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 1073741824" returned: 0 in 0.806s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:00 devstack sudo[113553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413
Jun 24 04:36:00 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:01 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413" returned: 0 in 0.624s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:01 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:01 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Attempting download of b2f74277-3203-4dd2-8bc4-719d19ecea05 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2f74277-3203-4dd2-8bc4-719d19ecea05', 'metadata': {}}])) to volume 1477f502-ab4c-49f6-a4e5-e345cbd6b413. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:36:01 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2decb-1c91-4b94-8dce-83058cc55c78]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f74277-3203-4dd2-8bc4-719d19ecea05_zlmpywgl {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:01 devstack sudo[113556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f74277-3203-4dd2-8bc4-719d19ecea05_zlmpywgl
Jun 24 04:36:01 devstack sudo[113556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:01 devstack sudo[113556]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f74277-3203-4dd2-8bc4-719d19ecea05_zlmpywgl" returned: 0 in 0.709s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f74277-3203-4dd2-8bc4-719d19ecea05_zlmpywgl {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:01 devstack sudo[113560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f74277-3203-4dd2-8bc4-719d19ecea05_zlmpywgl
Jun 24 04:36:01 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:02 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f74277-3203-4dd2-8bc4-719d19ecea05_zlmpywgl" returned: 1 in 0.708s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f74277-3203-4dd2-8bc4-719d19ecea05_zlmpywgl' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:02 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4777d2-882b-4703-8882-1fc0a0f198d7]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:02 devstack sudo[113565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD
Jun 24 04:36:02 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:03 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD" returned: 0 in 0.689s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:03 devstack sudo[113569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD
Jun 24 04:36:03 devstack sudo[113569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:03 devstack sudo[113569]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD" returned: 1 in 0.706s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:03 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] b2f74277-3203-4dd2-8bc4-719d19ecea05 was raw, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:36:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:04 devstack sudo[113574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413
Jun 24 04:36:04 devstack sudo[113574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:04 devstack sudo[113574]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413" returned: 0 in 0.686s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:04 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2f74277-3203-4dd2-8bc4-719d19ecea05_337_ax03devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:36:04 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Converted 0.00 MB image at 0.00 MB/s
Jun 24 04:36:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:04 devstack sudo[113579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 1G
Jun 24 04:36:04 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:05 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 1G" returned: 0 in 0.654s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:05 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9747159c-5410-4a5c-85fd-d9e6fea62bdc]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:05 devstack sudo[113586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413
Jun 24 04:36:05 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:06 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413" returned: 0 in 0.729s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:06 devstack sudo[113590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413
Jun 24 04:36:06 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:06 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413" returned: 1 in 0.726s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Downloaded image b2f74277-3203-4dd2-8bc4-719d19ecea05 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2f74277-3203-4dd2-8bc4-719d19ecea05', 'metadata': {}}])) to volume 1477f502-ab4c-49f6-a4e5-e345cbd6b413 successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Temporary image b2f74277-3203-4dd2-8bc4-719d19ecea05 for user c444e8f2ea0e48d29541f77abb2e6d38 is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Marking volume 1477f502-ab4c-49f6-a4e5-e345cbd6b413 as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Copying metadata from image b2f74277-3203-4dd2-8bc4-719d19ecea05 to 1477f502-ab4c-49f6-a4e5-e345cbd6b413. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Creating volume glance metadata for volume 1477f502-ab4c-49f6-a4e5-e345cbd6b413 backed by image b2f74277-3203-4dd2-8bc4-719d19ecea05 with: {'image_id': 'b2f74277-3203-4dd2-8bc4-719d19ecea05', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8012fd8a21f4fcb40c5d530acd88d944', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18e23b2-3547-4a85-8eb0-bd402a7960cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413', 'volume_size': 1, 'image_id': 'b2f74277-3203-4dd2-8bc4-719d19ecea05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f74277-3203-4dd2-8bc4-719d19ecea05', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8012fd8a21f4fcb40c5d530acd88d944', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9886c3d50d3643c1bae6a108682b687e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65e47d5b6839c36557847a237c67ab106a363e0a8633f5de53df85121a7bea815b26632cf45bdaf6197101d075123a55d2219023411e63e5bd96de306c181de6', 'id': 'b2f74277-3203-4dd2-8bc4-719d19ecea05', 'created_at': datetime.datetime(2026, 6, 24, 2, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f74277-3203-4dd2-8bc4-719d19ecea05/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76b090d0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1678b4c5-85be-44db-8055-54a2bd300cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:06 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Volume volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 (1477f502-ab4c-49f6-a4e5-e345cbd6b413): created successfully
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1678b4c5-85be-44db-8055-54a2bd300cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:06 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Flow 'volume_create_manager' (8d6d9041-ec53-43eb-b594-73e69f512be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-41784f4c-49ce-4e5e-b51e-ea42d0f80540 tempest-VolumeImageDependencyTests-351356667 None] Created volume successfully.
Jun 24 04:36:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Acquiring lock "cinder-1477f502-ab4c-49f6-a4e5-e345cbd6b413-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Lock "cinder-1477f502-ab4c-49f6-a4e5-e345cbd6b413-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Acquiring lock "cinder-quobyte-1477f502-ab4c-49f6-a4e5-e345cbd6b413" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Lock "cinder-quobyte-1477f502-ab4c-49f6-a4e5-e345cbd6b413" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a437525-9d79-4076-b630-b0b9282a4afd]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:08 devstack sudo[113596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413
Jun 24 04:36:08 devstack sudo[113596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:08 devstack sudo[113596]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413" returned: 0 in 0.721s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:08 devstack sudo[113600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413
Jun 24 04:36:08 devstack sudo[113600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:09 devstack sudo[113600]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413" returned: 1 in 0.732s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:09 devstack sudo[113606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413
Jun 24 04:36:09 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:10 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-1477f502-ab4c-49f6-a4e5-e345cbd6b413" returned: 0 in 0.638s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Lock "cinder-quobyte-1477f502-ab4c-49f6-a4e5-e345cbd6b413" released by "delete_volume" :: held 2.146s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Created reservations ['c04f5f97-bc2a-4932-bad3-833477357c07', 'd3f66548-b211-4824-a2c8-2b2f862814e7', '005e55a6-7360-43db-be72-c9ca2ed296cb', '2fe6cd3f-8047-4b83-86d0-8614fb3ba41b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:10 devstack sudo[113609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:10 devstack sudo[113609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:10 devstack sudo[113609]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.643s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:10 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Deleted volume successfully.
Jun 24 04:36:10 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-0d733041-764d-41ef-9dec-1010f373d2b9 tempest-VolumeImageDependencyTests-351356667 None] Lock "cinder-1477f502-ab4c-49f6-a4e5-e345cbd6b413-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:20 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=21,cinder:INSERT=11,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:36:20 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=21,cinder:SELECT=11,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (71fad6dc-04bd-45c4-b90e-f3e0cd64b7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eadaf6-6431-4a76-8e2c-54f58540d62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eadaf6-6431-4a76-8e2c-54f58540d62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823397063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1faf8c-7d24-4849-9735-0bb531e40906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:24Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed73c5c7-c9e5-4ac4-8168-a94d611e7f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed73c5c7-c9e5-4ac4-8168-a94d611e7f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f902e0e8-b08e-4723-829d-e815851c4731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f902e0e8-b08e-4723-829d-e815851c4731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1faf8c-7d24-4849-9735-0bb531e40906', 'volume_name': 'volume-fd1faf8c-7d24-4849-9735-0bb531e40906', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb18cd6f-b7bd-4e09-b145-d1f4cbe4e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb18cd6f-b7bd-4e09-b145-d1f4cbe4e56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493ec8f5-c22b-48b0-9717-29846744b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:24 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Volume fd1faf8c-7d24-4849-9735-0bb531e40906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1faf8c-7d24-4849-9735-0bb531e40906', 'volume_size': 1}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823397063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1faf8c-7d24-4849-9735-0bb531e40906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:24Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Creating volume fd1faf8c-7d24-4849-9735-0bb531e40906 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:24 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:24 devstack sudo[113687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906 1073741824
Jun 24 04:36:24 devstack sudo[113687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (8e6d1aae-b672-40ba-811b-7b0f160d6daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8824f7cb-5e77-4bfd-9de5-e89573c53031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (af84e6bc-b9bd-49c8-910c-475fe39d0ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff04329-7d2d-4f93-a4ab-6a3b2f771002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8824f7cb-5e77-4bfd-9de5-e89573c53031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-105676390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c0fc52-de16-4c07-8de5-f471e67726b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:24Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465ce547-a1b8-4ba2-9636-43c0f02cc84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465ce547-a1b8-4ba2-9636-43c0f02cc84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a652607-a817-485e-803b-ad6df9d5e059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a652607-a817-485e-803b-ad6df9d5e059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c0fc52-de16-4c07-8de5-f471e67726b5', 'volume_name': 'volume-35c0fc52-de16-4c07-8de5-f471e67726b5', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5682af2f-805a-4b4e-90de-ad1189d51c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5682af2f-805a-4b4e-90de-ad1189d51c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7607569-76fe-48d7-80aa-2e7bde5fc7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume 35c0fc52-de16-4c07-8de5-f471e67726b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c0fc52-de16-4c07-8de5-f471e67726b5', 'volume_size': 1}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff04329-7d2d-4f93-a4ab-6a3b2f771002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1949183562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90a0b6-7541-45f4-a9c9-a993260878de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:25Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92ddbef-681c-4404-b7f3-15178e2ca4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92ddbef-681c-4404-b7f3-15178e2ca4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef98cfd-9c51-4793-b569-c254af95e825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef98cfd-9c51-4793-b569-c254af95e825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d90a0b6-7541-45f4-a9c9-a993260878de', 'volume_name': 'volume-7d90a0b6-7541-45f4-a9c9-a993260878de', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478ac67b-c4b7-4a6c-81c7-af02894fa24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478ac67b-c4b7-4a6c-81c7-af02894fa24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3168e44d-abda-4d50-8b02-2953980f180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Volume 7d90a0b6-7541-45f4-a9c9-a993260878de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d90a0b6-7541-45f4-a9c9-a993260878de', 'volume_size': 1}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (431b5c5b-e6bf-49af-bd58-adc10e3b60fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22df8b9-84db-4bad-98a1-75156ea3700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22df8b9-84db-4bad-98a1-75156ea3700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855765940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0b429f-3932-4068-a8ef-0203337adc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:25Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ae4dc9-7b88-423f-a8a0-ef0c6bf3b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ae4dc9-7b88-423f-a8a0-ef0c6bf3b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c498da-6e01-44d4-8595-b11fdfd1bc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c498da-6e01-44d4-8595-b11fdfd1bc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0b429f-3932-4068-a8ef-0203337adc9e', 'volume_name': 'volume-7a0b429f-3932-4068-a8ef-0203337adc9e', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622edfd2-089f-486c-a157-24d15c3c274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622edfd2-089f-486c-a157-24d15c3c274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e348253-610e-4344-b16d-7a212d5c5ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Volume 7a0b429f-3932-4068-a8ef-0203337adc9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0b429f-3932-4068-a8ef-0203337adc9e', 'volume_size': 1}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (e9160e1b-0830-4e82-a6da-4f8f34f1a348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeef891-3f12-4299-b386-0d8d6b1bd5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeef891-3f12-4299-b386-0d8d6b1bd5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023173456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a5eacc-5dba-43ba-90c9-000f445fdd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:26Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f54ae02-5240-469e-bd46-caeded2e0d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f54ae02-5240-469e-bd46-caeded2e0d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648dd79a-56d5-4f35-b04b-d66747c2f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648dd79a-56d5-4f35-b04b-d66747c2f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a5eacc-5dba-43ba-90c9-000f445fdd47', 'volume_name': 'volume-69a5eacc-5dba-43ba-90c9-000f445fdd47', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c2ea89-88ff-418b-aece-91a270efc3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c2ea89-88ff-418b-aece-91a270efc3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbbad8d-050f-435b-a0d7-acd15eb7facb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:25 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Volume 69a5eacc-5dba-43ba-90c9-000f445fdd47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a5eacc-5dba-43ba-90c9-000f445fdd47', 'volume_size': 1}
Jun 24 04:36:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:26 devstack sudo[113687]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906 1073741824" returned: 0 in 1.391s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:26 devstack sudo[113693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906
Jun 24 04:36:26 devstack sudo[113693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (fc9535e1-4c62-46a0-9628-350f721acd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cb93dc-0e3f-4431-aa13-d4201c86e2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cb93dc-0e3f-4431-aa13-d4201c86e2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326931930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedf0928-9d28-4d81-8d45-e40bb3f9fa21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:26Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c1046c-8e03-455a-84a0-d69ea977114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c1046c-8e03-455a-84a0-d69ea977114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405020ae-7690-409b-9169-41a3587e41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405020ae-7690-409b-9169-41a3587e41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fedf0928-9d28-4d81-8d45-e40bb3f9fa21', 'volume_name': 'volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f69e4a-2b51-4d00-b4da-fdd229d25feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f69e4a-2b51-4d00-b4da-fdd229d25feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2992be7f-ce96-401f-ade3-c79e8ee46081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:26 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Volume fedf0928-9d28-4d81-8d45-e40bb3f9fa21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21', 'volume_size': 1}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:26 devstack sudo[113693]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906" returned: 0 in 0.721s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.861s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-105676390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c0fc52-de16-4c07-8de5-f471e67726b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:24Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Creating volume 35c0fc52-de16-4c07-8de5-f471e67726b5 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:26 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493ec8f5-c22b-48b0-9717-29846744b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1faf8c-7d24-4849-9735-0bb531e40906', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:26 devstack sudo[113697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5 1073741824
Jun 24 04:36:26 devstack sudo[113697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7aaacb-0b15-4f9a-bde5-533fd9d9c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:27 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Volume volume-fd1faf8c-7d24-4849-9735-0bb531e40906 (fd1faf8c-7d24-4849-9735-0bb531e40906): created successfully
Jun 24 04:36:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7aaacb-0b15-4f9a-bde5-533fd9d9c023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (71fad6dc-04bd-45c4-b90e-f3e0cd64b7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ff100fe3-3a2b-4da2-8bc1-a9326b076f67 tempest-CreateVolumesFromImageTest-963516763 None] Created volume successfully.
Jun 24 04:36:27 devstack sudo[113697]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5 1073741824" returned: 0 in 0.975s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:28 devstack sudo[113704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5
Jun 24 04:36:28 devstack sudo[113704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Flow 'volume_create_manager' (4f73ad14-dd92-44d0-a807-fbba65930ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90ba019-de83-4ab0-ae6a-fc2ad1075840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90ba019-de83-4ab0-ae6a-fc2ad1075840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aca951-daf1-4d7b-a09d-6bf3f1d28c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab82f85933e4b7c99b61be2e545f264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:29Z,use_quota=True,user_id='869b47d00be44c528eb0708c78e091b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96a8eca1-4ba8-4790-abbb-892a8bf01db7),volume_type_id=96a8eca1-4ba8-4790-abbb-892a8bf01db7)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b46ffe5-d585-4318-bc7b-e839e0223889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b46ffe5-d585-4318-bc7b-e839e0223889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c835d27-f715-4393-a9ce-4a8e558f41c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:36:28 devstack sudo[113704]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5" returned: 0 in 0.847s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.635s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1949183562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90a0b6-7541-45f4-a9c9-a993260878de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:25Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Creating volume 7d90a0b6-7541-45f4-a9c9-a993260878de {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:28 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7607569-76fe-48d7-80aa-2e7bde5fc7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c0fc52-de16-4c07-8de5-f471e67726b5', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e1b0be-7506-42a0-85b8-b2f49131332d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:28 devstack sudo[113707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de 1073741824
Jun 24 04:36:28 devstack sudo[113707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:28 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume volume-35c0fc52-de16-4c07-8de5-f471e67726b5 (35c0fc52-de16-4c07-8de5-f471e67726b5): created successfully
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e1b0be-7506-42a0-85b8-b2f49131332d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (8e6d1aae-b672-40ba-811b-7b0f160d6daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:28 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9c3c93e7-9c10-4b6a-ba15-31cf08335289 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created volume successfully.
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c835d27-f715-4393-a9ce-4a8e558f41c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99aca951-daf1-4d7b-a09d-6bf3f1d28c7c', 'volume_name': 'volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c', 'volume_size': 1, 'image_id': 'f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49fd2c229ae5f1c672f90b11dccf9bac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dab82f85933e4b7c99b61be2e545f264', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdddb37f86e9fde40c9c6e1cf7bde40c8fc9dc78ac9ffd8f1d88a396dd1706caa05c579872b2eb54b5a131a502a89747a69fbb1a2f125d175267b6fb084b6741', 'id': 'f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'created_at': datetime.datetime(2026, 6, 24, 2, 36, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 36, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76ae4230>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456d1188-69e2-4ebf-9f68-5a044982af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456d1188-69e2-4ebf-9f68-5a044982af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b38fedb-a50e-4de8-a64e-fa6f588e1a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:29 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Volume 99aca951-daf1-4d7b-a09d-6bf3f1d28c7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c', 'volume_size': 1, 'image_id': 'f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49fd2c229ae5f1c672f90b11dccf9bac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dab82f85933e4b7c99b61be2e545f264', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdddb37f86e9fde40c9c6e1cf7bde40c8fc9dc78ac9ffd8f1d88a396dd1706caa05c579872b2eb54b5a131a502a89747a69fbb1a2f125d175267b6fb084b6741', 'id': 'f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'created_at': datetime.datetime(2026, 6, 24, 2, 36, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 36, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76ae4230>}
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Trying to clone 99aca951-daf1-4d7b-a09d-6bf3f1d28c7c from image f61db0d1-3d8c-4e5a-bfaf-5493291c28d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:36:29 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Image download 0.00 MB at 0.00 MB/s
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ecf9d1-6b0b-419e-b341-d524a7f9ab43]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:29 devstack sudo[113709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD
Jun 24 04:36:29 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:29 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:30 devstack sudo[113707]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de 1073741824" returned: 0 in 1.205s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:30 devstack sudo[113715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de
Jun 24 04:36:30 devstack sudo[113715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:30 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:30 devstack sudo[113719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD
Jun 24 04:36:30 devstack sudo[113719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:30 devstack sudo[113715]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de" returned: 0 in 0.771s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.531s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855765940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0b429f-3932-4068-a8ef-0203337adc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:25Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Creating volume 7a0b429f-3932-4068-a8ef-0203337adc9e {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:30 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3168e44d-abda-4d50-8b02-2953980f180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d90a0b6-7541-45f4-a9c9-a993260878de', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:30 devstack sudo[113722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e 1073741824
Jun 24 04:36:30 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d00d3f-f341-4707-a93a-da0f04435d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:30 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Volume volume-7d90a0b6-7541-45f4-a9c9-a993260878de (7d90a0b6-7541-45f4-a9c9-a993260878de): created successfully
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d00d3f-f341-4707-a93a-da0f04435d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:30 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (af84e6bc-b9bd-49c8-910c-475fe39d0ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:31 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-8b270833-7b05-4258-9c84-73adf7600ba2 tempest-CreateVolumesFromImageTest-963516763 None] Created volume successfully.
Jun 24 04:36:31 devstack sudo[113719]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD" returned: 1 in 0.968s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:31 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Temporary image f61db0d1-3d8c-4e5a-bfaf-5493291c28d6 is fetched for user 869b47d00be44c528eb0708c78e091b6. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:36:31 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a6ca34-b29b-4d7d-aac5-49ca59333b4d]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:31 devstack sudo[113727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD
Jun 24 04:36:31 devstack sudo[113727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:31 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:31 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e 1073741824" returned: 0 in 1.088s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:32 devstack sudo[113733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e
Jun 24 04:36:32 devstack sudo[113733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:32 devstack sudo[113727]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD" returned: 0 in 1.008s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:32 devstack sudo[113737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD
Jun 24 04:36:32 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:32 devstack sudo[113733]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e" returned: 0 in 0.832s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.077s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023173456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a5eacc-5dba-43ba-90c9-000f445fdd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:26Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Creating volume 69a5eacc-5dba-43ba-90c9-000f445fdd47 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:32 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:32 devstack sudo[113740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47 1073741824
Jun 24 04:36:32 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e348253-610e-4344-b16d-7a212d5c5ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0b429f-3932-4068-a8ef-0203337adc9e', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b149c9ee-bb2b-4985-8a40-4f0e54576e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:32 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Volume volume-7a0b429f-3932-4068-a8ef-0203337adc9e (7a0b429f-3932-4068-a8ef-0203337adc9e): created successfully
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b149c9ee-bb2b-4985-8a40-4f0e54576e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:32 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (431b5c5b-e6bf-49af-bd58-adc10e3b60fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:33 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-1918f02a-2f23-48f7-aa77-bc18f724bc0e tempest-CreateVolumesFromImageTest-963516763 None] Created volume successfully.
Jun 24 04:36:33 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD" returned: 1 in 0.934s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:33 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:34 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47 1073741824" returned: 0 in 1.223s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:34 devstack sudo[113748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47
Jun 24 04:36:34 devstack sudo[113748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:34 devstack sudo[113748]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47" returned: 0 in 0.650s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.477s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326931930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedf0928-9d28-4d81-8d45-e40bb3f9fa21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6320e9d3393b4171ab0d6b713b22063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:26Z,use_quota=True,user_id='7a89ab6105f74a699253a5b3a6cba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Creating volume fedf0928-9d28-4d81-8d45-e40bb3f9fa21 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:34 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbbad8d-050f-435b-a0d7-acd15eb7facb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a5eacc-5dba-43ba-90c9-000f445fdd47', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:34 devstack sudo[113751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21 1073741824
Jun 24 04:36:34 devstack sudo[113751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f6068b-b7b5-466c-b0d5-d1f308c05a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:34 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Volume volume-69a5eacc-5dba-43ba-90c9-000f445fdd47 (69a5eacc-5dba-43ba-90c9-000f445fdd47): created successfully
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f6068b-b7b5-466c-b0d5-d1f308c05a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:34 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (e9160e1b-0830-4e82-a6da-4f8f34f1a348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:34 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2902b5d6-2490-4530-85f5-6236468ffec3 tempest-CreateVolumesFromImageTest-963516763 None] Created volume successfully.
Jun 24 04:36:35 devstack sudo[113751]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21 1073741824" returned: 0 in 0.909s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:35 devstack sudo[113757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21
Jun 24 04:36:35 devstack sudo[113757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:36 devstack sudo[113757]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21" returned: 0 in 0.697s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.528s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2992be7f-ce96-401f-ade3-c79e8ee46081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a642003-a534-4019-943a-d48fa83314db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Creating offline snapshot 1fb40b1d-d79d-4d4e-9e4b-4273fe892090 of volume 35c0fc52-de16-4c07-8de5-f471e67726b5 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:36:36 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Volume volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21 (fedf0928-9d28-4d81-8d45-e40bb3f9fa21): created successfully
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a642003-a534-4019-943a-d48fa83314db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Flow 'volume_create_manager' (fc9535e1-4c62-46a0-9628-350f721acd54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cfc5b8-feb5-4423-a62c-f61b35922c55]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:36 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-88e6ba8b-2b2f-4be5-a775-a157c917da49 tempest-CreateVolumesFromImageTest-963516763 None] Created volume successfully.
Jun 24 04:36:36 devstack sudo[113761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5
Jun 24 04:36:36 devstack sudo[113761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:37 devstack sudo[113761]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5" returned: 0 in 0.796s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:37 devstack sudo[113766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 1G
Jun 24 04:36:37 devstack sudo[113766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-fedf0928-9d28-4d81-8d45-e40bb3f9fa21-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-fedf0928-9d28-4d81-8d45-e40bb3f9fa21-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-quobyte-fedf0928-9d28-4d81-8d45-e40bb3f9fa21" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:37 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-fedf0928-9d28-4d81-8d45-e40bb3f9fa21" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb9da4e-d3c7-4acb-9a1f-be5017055e30]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:37 devstack sudo[113768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21
Jun 24 04:36:37 devstack sudo[113768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:38 devstack sudo[113766]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 1G" returned: 0 in 0.870s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c0fc52-de16-4c07-8de5-f471e67726b5 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:38 devstack sudo[113775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c0fc52-de16-4c07-8de5-f471e67726b5 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090
Jun 24 04:36:38 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:38 devstack sudo[113768]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21" returned: 0 in 0.841s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:38 devstack sudo[113780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21
Jun 24 04:36:38 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:38 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c0fc52-de16-4c07-8de5-f471e67726b5 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090" returned: 0 in 0.780s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:39 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 is being set with open permissions: ugo+rw
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:39 devstack sudo[113785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090
Jun 24 04:36:39 devstack sudo[113785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:39 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fedf0928-9d28-4d81-8d45-e40bb3f9fa21" returned: 0 in 0.780s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-fedf0928-9d28-4d81-8d45-e40bb3f9fa21" released by "delete_volume" :: held 1.678s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Created reservations ['5c7c5696-637f-4cbd-a599-e5171e97b993', '2d60953b-add9-4cc1-8079-d7b801c8c26d', '58d6ca37-c5de-4a77-80c2-f401ab1417dd', '01fd51ea-10ea-4695-9309-9f3b6fb2021a'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:39 devstack sudo[113788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:39 devstack sudo[113788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-69a5eacc-5dba-43ba-90c9-000f445fdd47-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:39 devstack sudo[113785]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090" returned: 0 in 0.762s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-69a5eacc-5dba-43ba-90c9-000f445fdd47-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-quobyte-69a5eacc-5dba-43ba-90c9-000f445fdd47" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-69a5eacc-5dba-43ba-90c9-000f445fdd47" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:39 devstack sudo[113791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.info
Jun 24 04:36:39 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[642bed01-0ec9-4463-ba06-0f97386e1a74]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:40 devstack sudo[113793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47
Jun 24 04:36:40 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:40 devstack sudo[113788]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.809s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:40 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:40 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Deleted volume successfully.
Jun 24 04:36:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-469094eb-7429-4973-83a9-fe00cf186330 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-fedf0928-9d28-4d81-8d45-e40bb3f9fa21-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:40 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.info" returned: 0 in 0.944s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:40 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.info is being set with open permissions: ugo+rw
Jun 24 04:36:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:40 devstack sudo[113797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.info
Jun 24 04:36:40 devstack sudo[113797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:40 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47" returned: 0 in 1.075s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:41 devstack sudo[113802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47
Jun 24 04:36:41 devstack sudo[113802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:41 devstack sudo[113797]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.info" returned: 0 in 0.699s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.020s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.196s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aca951-daf1-4d7b-a09d-6bf3f1d28c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab82f85933e4b7c99b61be2e545f264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:29Z,use_quota=True,user_id='869b47d00be44c528eb0708c78e091b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96a8eca1-4ba8-4790-abbb-892a8bf01db7),volume_type_id=96a8eca1-4ba8-4790-abbb-892a8bf01db7)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Creating volume 99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:41 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:41 devstack sudo[113805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c 1073741824
Jun 24 04:36:41 devstack sudo[113805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:41 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-10ffe74a-e67f-40d8-bc5f-8b4964add147 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Create snapshot completed successfully
Jun 24 04:36:41 devstack sudo[113802]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-69a5eacc-5dba-43ba-90c9-000f445fdd47" returned: 0 in 0.691s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-69a5eacc-5dba-43ba-90c9-000f445fdd47" released by "delete_volume" :: held 1.839s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Created reservations ['ad5f8ba3-85fe-4615-a6ca-c5b8333b1cfe', '88465a3c-a6c0-42ab-8d86-4097f9f05565', 'bbf34ddf-d9b2-4b2f-b94d-aa6806e020af', 'ba1f3aef-d169-4701-83fb-94b5e456e3eb'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:41 devstack sudo[113808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:41 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-7a0b429f-3932-4068-a8ef-0203337adc9e-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-7a0b429f-3932-4068-a8ef-0203337adc9e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-quobyte-7a0b429f-3932-4068-a8ef-0203337adc9e" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-7a0b429f-3932-4068-a8ef-0203337adc9e" acquired by "delete_volume" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0f042d-be88-4362-a2d4-c156c4d46bf5]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:42 devstack sudo[113813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e
Jun 24 04:36:42 devstack sudo[113813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:42 devstack sudo[113805]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c 1073741824" returned: 0 in 1.042s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:42 devstack sudo[113817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c
Jun 24 04:36:42 devstack sudo[113817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:42 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.951s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Deleted volume successfully.
Jun 24 04:36:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d0c58d87-8f90-44b1-af82-58a2bfa8a4cb tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-69a5eacc-5dba-43ba-90c9-000f445fdd47-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (8cdc3aa0-020a-4d40-8574-90b4b915915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76d255f-fd41-4f30-a4b4-b0a41d02ba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76d255f-fd41-4f30-a4b4-b0a41d02ba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296106477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192a2f09-a4d0-4c91-bc4e-91125f151950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:43Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269622b8-790e-4c9c-bf58-b5c48be5755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269622b8-790e-4c9c-bf58-b5c48be5755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05749573-cbcd-46e5-ae45-9539363ea759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05749573-cbcd-46e5-ae45-9539363ea759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192a2f09-a4d0-4c91-bc4e-91125f151950', 'volume_name': 'volume-192a2f09-a4d0-4c91-bc4e-91125f151950', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255299c3-c5fe-4020-9bfd-b5fdecaf3b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255299c3-c5fe-4020-9bfd-b5fdecaf3b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3da394b-b7b7-4ccf-be9d-414f8620f7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:43 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume 192a2f09-a4d0-4c91-bc4e-91125f151950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192a2f09-a4d0-4c91-bc4e-91125f151950', 'volume_size': 1}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:43 devstack sudo[113813]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e" returned: 0 in 1.295s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:43 devstack sudo[113823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e
Jun 24 04:36:43 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:43 devstack sudo[113817]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" returned: 0 in 1.103s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296106477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192a2f09-a4d0-4c91-bc4e-91125f151950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:43Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Creating volume 192a2f09-a4d0-4c91-bc4e-91125f151950 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:43 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:43 devstack sudo[113825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950 1073741824
Jun 24 04:36:43 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Attempting download of f61db0d1-3d8c-4e5a-bfaf-5493291c28d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'metadata': {}}])) to volume 99aca951-daf1-4d7b-a09d-6bf3f1d28c7c. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76ad298-c6ea-453b-8a7f-1744abaac681]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_giv_hpdc {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:43 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (034e565d-f5fe-4d71-98c8-389fbd272a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a27e4f7-423e-4c14-b909-71ba4374bb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a27e4f7-423e-4c14-b909-71ba4374bb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255015829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bb30e5-1eed-4105-84e4-b870c2252ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:44Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa96ae07-a8a0-4b0c-81e2-7651573e2e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa96ae07-a8a0-4b0c-81e2-7651573e2e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85d93dd-641b-4b0f-ac98-571eb7f4ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85d93dd-641b-4b0f-ac98-571eb7f4ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bb30e5-1eed-4105-84e4-b870c2252ed5', 'volume_name': 'volume-40bb30e5-1eed-4105-84e4-b870c2252ed5', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b987aa6a-2457-4fbe-95b0-0a36ecf72e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b987aa6a-2457-4fbe-95b0-0a36ecf72e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c22454e-14a2-4e5c-bd2d-0dc6b95cfd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume 40bb30e5-1eed-4105-84e4-b870c2252ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bb30e5-1eed-4105-84e4-b870c2252ed5', 'volume_size': 1}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:44 devstack sudo[113827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_giv_hpdc
Jun 24 04:36:44 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:44 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7a0b429f-3932-4068-a8ef-0203337adc9e" returned: 0 in 1.033s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-7a0b429f-3932-4068-a8ef-0203337adc9e" released by "delete_volume" :: held 2.402s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (1f2bfa25-db8c-4004-91d5-43dd72d7031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d737804-d267-41a1-80ef-e053de54e134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d737804-d267-41a1-80ef-e053de54e134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1394641909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ad0c2f-9aee-4eca-9627-e02dab70b44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:44Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65918374-d72b-45a4-b760-bea0c75c4c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65918374-d72b-45a4-b760-bea0c75c4c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cec5418-b0fe-41f6-8d5d-b7b17b6e545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cec5418-b0fe-41f6-8d5d-b7b17b6e545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ad0c2f-9aee-4eca-9627-e02dab70b44a', 'volume_name': 'volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a396959-3457-4e16-b0b4-cc01e74a9dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a396959-3457-4e16-b0b4-cc01e74a9dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f950ab1c-89ed-44cb-87bb-10d2cb69e585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:44 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume 95ad0c2f-9aee-4eca-9627-e02dab70b44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a', 'volume_size': 1}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Created reservations ['0c7bc0cf-41d3-4af9-88b6-f8b5d6151a86', '6abae4e6-5575-456c-908d-acdc48d8aac0', '8869ee79-bf5a-423e-9769-ad014b166cdf', '70f8c372-b9ec-4a35-abc9-a7f53fb9d569'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:45 devstack sudo[113834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:45 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:45 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950 1073741824" returned: 0 in 1.438s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (e1f1e4fb-f706-4a70-adfa-b86c3714c285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a458266-ab09-44c3-a640-7caaa63b0778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a458266-ab09-44c3-a640-7caaa63b0778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858334397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74acdea7-d084-4fb9-a89b-06f3b9048071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:45Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e06699-b119-481a-adb1-199a04bcd7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e06699-b119-481a-adb1-199a04bcd7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de7c61c-2779-47a8-8839-aa8dc02cc0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de7c61c-2779-47a8-8839-aa8dc02cc0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74acdea7-d084-4fb9-a89b-06f3b9048071', 'volume_name': 'volume-74acdea7-d084-4fb9-a89b-06f3b9048071', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c922170e-570c-4d02-affd-d0e2f95f0c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c922170e-570c-4d02-affd-d0e2f95f0c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6490d975-706e-4d0a-b3a1-7ff37f446841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:45 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume 74acdea7-d084-4fb9-a89b-06f3b9048071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74acdea7-d084-4fb9-a89b-06f3b9048071', 'volume_size': 1}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:45 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_giv_hpdc" returned: 0 in 1.485s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_giv_hpdc {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:45 devstack sudo[113838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:45 devstack sudo[113838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:45 devstack sudo[113841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950
Jun 24 04:36:45 devstack sudo[113841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-7d90a0b6-7541-45f4-a9c9-a993260878de-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-7d90a0b6-7541-45f4-a9c9-a993260878de-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:45 devstack sudo[113839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_giv_hpdc
Jun 24 04:36:45 devstack sudo[113839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-quobyte-7d90a0b6-7541-45f4-a9c9-a993260878de" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-7d90a0b6-7541-45f4-a9c9-a993260878de" acquired by "delete_volume" :: waited 0.026s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a023d0c-b77b-4b40-afe4-45a31f4712f0]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (9ca23aca-3127-4f58-89b3-fd6a61465b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed48ba4-a26c-46aa-9d3d-b0fede809519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed48ba4-a26c-46aa-9d3d-b0fede809519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-385992358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e742304f-334b-4ef3-a443-502caf4b78b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:46Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aa2b17-2991-4a9e-9741-39d41a72fd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aa2b17-2991-4a9e-9741-39d41a72fd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707f5e6e-3c91-4574-b25f-151a84db0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707f5e6e-3c91-4574-b25f-151a84db0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e742304f-334b-4ef3-a443-502caf4b78b2', 'volume_name': 'volume-e742304f-334b-4ef3-a443-502caf4b78b2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66448c5f-b2a1-4281-93c6-7ae0386a7438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66448c5f-b2a1-4281-93c6-7ae0386a7438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:46 devstack sudo[113844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de
Jun 24 04:36:46 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bd209e-8a09-400c-ade3-ce735f647ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:46 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume e742304f-334b-4ef3-a443-502caf4b78b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e742304f-334b-4ef3-a443-502caf4b78b2', 'volume_size': 1}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:46 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.378s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Deleted volume successfully.
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-65485adf-ee08-4d04-a5c1-9e5bd6a0a116 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-7a0b429f-3932-4068-a8ef-0203337adc9e-delete_volume" released by "delete_volume" :: held 4.299s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:46 devstack sudo[113838]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 1.251s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:36:46 devstack sudo[113841]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950" returned: 0 in 1.209s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] <== create_volume: return (2944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.949s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.544s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255015829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bb30e5-1eed-4105-84e4-b870c2252ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:44Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Creating volume 40bb30e5-1eed-4105-84e4-b870c2252ed5 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:46 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3da394b-b7b7-4ccf-be9d-414f8620f7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192a2f09-a4d0-4c91-bc4e-91125f151950', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:46 devstack sudo[113851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5 1073741824
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7778a521-9dfa-4105-9a59-a2a10b1afdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:46 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:46 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume volume-192a2f09-a4d0-4c91-bc4e-91125f151950 (192a2f09-a4d0-4c91-bc4e-91125f151950): created successfully
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7778a521-9dfa-4105-9a59-a2a10b1afdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (8cdc3aa0-020a-4d40-8574-90b4b915915c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-72f38859-bcc5-4075-9241-82d4f4821688 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created volume successfully.
Jun 24 04:36:46 devstack sudo[113839]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_giv_hpdc" returned: 1 in 1.481s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_giv_hpdc' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fe142a-8bb8-498d-b265-0aef805f6b5e]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:47 devstack sudo[113854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD
Jun 24 04:36:47 devstack sudo[113854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:47 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de" returned: 0 in 1.369s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:47 devstack sudo[113859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de
Jun 24 04:36:47 devstack sudo[113859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:47 devstack sudo[113854]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD" returned: 0 in 0.920s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:47 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5 1073741824" returned: 0 in 1.297s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:48 devstack sudo[113867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD
Jun 24 04:36:48 devstack sudo[113867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:48 devstack sudo[113869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5
Jun 24 04:36:48 devstack sudo[113869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:48 devstack sudo[113859]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-7d90a0b6-7541-45f4-a9c9-a993260878de" returned: 0 in 0.899s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-7d90a0b6-7541-45f4-a9c9-a993260878de" released by "delete_volume" :: held 2.362s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Created reservations ['e65a39bb-5e5a-4b8e-9f82-2b1aab0fe951', '434ec213-3ced-404b-bcf0-5c798a048934', '1828b0a8-7c16-4060-8cc2-0d352b08f354', '83ad763e-8db9-4c39-8ce6-d8ec2ef2f785'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:48 devstack sudo[113872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:48 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:48 devstack sudo[113867]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD" returned: 1 in 1.097s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] f61db0d1-3d8c-4e5a-bfaf-5493291c28d6 was raw, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:36:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:48 devstack sudo[113877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c
Jun 24 04:36:48 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:49 devstack sudo[113869]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5" returned: 0 in 1.091s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] <== create_volume: return (2459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.366s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1394641909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ad0c2f-9aee-4eca-9627-e02dab70b44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:44Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Creating volume 95ad0c2f-9aee-4eca-9627-e02dab70b44a {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:49 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c22454e-14a2-4e5c-bd2d-0dc6b95cfd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bb30e5-1eed-4105-84e4-b870c2252ed5', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f2cf65-924d-42f9-97b0-ddab4d1b2ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:49 devstack sudo[113880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a 1073741824
Jun 24 04:36:49 devstack sudo[113880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-fd1faf8c-7d24-4849-9735-0bb531e40906-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:49 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume volume-40bb30e5-1eed-4105-84e4-b870c2252ed5 (40bb30e5-1eed-4105-84e4-b870c2252ed5): created successfully
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f2cf65-924d-42f9-97b0-ddab4d1b2ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (034e565d-f5fe-4d71-98c8-389fbd272a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-fd1faf8c-7d24-4849-9735-0bb531e40906-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4bfd8484-8c5d-4b90-9418-28c165d087d0 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created volume successfully.
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "cinder-quobyte-fd1faf8c-7d24-4849-9735-0bb531e40906" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-fd1faf8c-7d24-4849-9735-0bb531e40906" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2677adfb-7392-48a9-9e03-ec3907ac2e9e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:49 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.945s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Deleted volume successfully.
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-28b11a76-a364-4c51-a105-9bd96c8f973f tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-7d90a0b6-7541-45f4-a9c9-a993260878de-delete_volume" released by "delete_volume" :: held 3.807s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:49 devstack sudo[113883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906
Jun 24 04:36:49 devstack sudo[113883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:49 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" returned: 0 in 0.991s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f61db0d1-3d8c-4e5a-bfaf-5493291c28d6_x0xgc72rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:36:49 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Converted 0.00 MB image at 0.00 MB/s
Jun 24 04:36:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:49 devstack sudo[113888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c 1G
Jun 24 04:36:49 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Flow 'volume_create_manager' (4b66effa-1f45-418f-9ab2-b82276d73f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2839d2-6a8c-4e32-88e6-b624fe0c258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2839d2-6a8c-4e32-88e6-b624fe0c258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-145371093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e26badf-cd6a-4090-8fc0-e298144caf67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56457270b55d4a1ea020bb89d595ccd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:50Z,use_quota=True,user_id='ac23ddd3afe84610b2c89fcb87ed72cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463fa53e-3e8d-4389-91b9-e47148ce1f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463fa53e-3e8d-4389-91b9-e47148ce1f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d6e23f-27ee-4b7c-8e88-a0b812f5fd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d6e23f-27ee-4b7c-8e88-a0b812f5fd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e26badf-cd6a-4090-8fc0-e298144caf67', 'volume_name': 'volume-0e26badf-cd6a-4090-8fc0-e298144caf67', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99a9408-a720-4fb1-810d-fc00b6790ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99a9408-a720-4fb1-810d-fc00b6790ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60f65b8-d819-4289-8b14-ec270048cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:50 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Volume 0e26badf-cd6a-4090-8fc0-e298144caf67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e26badf-cd6a-4090-8fc0-e298144caf67', 'volume_size': 1}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:50 devstack sudo[113880]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a 1073741824" returned: 0 in 1.145s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:50 devstack sudo[113897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a
Jun 24 04:36:50 devstack sudo[113897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:50 devstack sudo[113883]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906" returned: 0 in 0.991s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:50 devstack sudo[113899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906
Jun 24 04:36:50 devstack sudo[113899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:50 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c 1G" returned: 0 in 0.791s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46e829a-dbc6-4a36-8472-38274848f239]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:50 devstack sudo[113904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c
Jun 24 04:36:50 devstack sudo[113904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:51 devstack sudo[113897]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a" returned: 0 in 0.701s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.722s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858334397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74acdea7-d084-4fb9-a89b-06f3b9048071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:45Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Creating volume 74acdea7-d084-4fb9-a89b-06f3b9048071 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:51 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f950ab1c-89ed-44cb-87bb-10d2cb69e585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:51 devstack sudo[113908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071 1073741824
Jun 24 04:36:51 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1061825f-50de-4afc-965f-700f29e63ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:51 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a (95ad0c2f-9aee-4eca-9627-e02dab70b44a): created successfully
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1061825f-50de-4afc-965f-700f29e63ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (1f2bfa25-db8c-4004-91d5-43dd72d7031d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-fec31366-e10f-4fd5-87ab-4956874b0ccb tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created volume successfully.
Jun 24 04:36:51 devstack sudo[113899]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-fd1faf8c-7d24-4849-9735-0bb531e40906" returned: 0 in 0.754s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-quobyte-fd1faf8c-7d24-4849-9735-0bb531e40906" released by "delete_volume" :: held 1.809s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Created reservations ['d515ae26-32cc-488f-9749-64f09abedb07', 'fc858bf4-0abb-47f4-9fb9-19846a62794c', '13f22bde-94f3-4794-ba33-1a7fadb8e87b', 'd75e7d97-70c5-457c-a095-55c29a14886a'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:51 devstack sudo[113910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:51 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:51 devstack sudo[113904]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" returned: 0 in 0.808s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:51 devstack sudo[113914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c
Jun 24 04:36:51 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:52 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071 1073741824" returned: 0 in 0.999s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:52 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.769s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:52 devstack sudo[113921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071
Jun 24 04:36:52 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Deleted volume successfully.
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4fb66bc3-f1be-4c4f-a1db-c814aad48fc3 tempest-CreateVolumesFromImageTest-963516763 None] Lock "cinder-fd1faf8c-7d24-4849-9735-0bb531e40906-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:52 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" returned: 1 in 0.963s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Downloaded image f61db0d1-3d8c-4e5a-bfaf-5493291c28d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'metadata': {}}])) to volume 99aca951-daf1-4d7b-a09d-6bf3f1d28c7c successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Temporary image f61db0d1-3d8c-4e5a-bfaf-5493291c28d6 for user 869b47d00be44c528eb0708c78e091b6 is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Marking volume 99aca951-daf1-4d7b-a09d-6bf3f1d28c7c as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Copying metadata from image f61db0d1-3d8c-4e5a-bfaf-5493291c28d6 to 99aca951-daf1-4d7b-a09d-6bf3f1d28c7c. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Creating volume glance metadata for volume 99aca951-daf1-4d7b-a09d-6bf3f1d28c7c backed by image f61db0d1-3d8c-4e5a-bfaf-5493291c28d6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '49fd2c229ae5f1c672f90b11dccf9bac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b38fedb-a50e-4de8-a64e-fa6f588e1a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c', 'volume_size': 1, 'image_id': 'f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49fd2c229ae5f1c672f90b11dccf9bac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dab82f85933e4b7c99b61be2e545f264', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdddb37f86e9fde40c9c6e1cf7bde40c8fc9dc78ac9ffd8f1d88a396dd1706caa05c579872b2eb54b5a131a502a89747a69fbb1a2f125d175267b6fb084b6741', 'id': 'f61db0d1-3d8c-4e5a-bfaf-5493291c28d6', 'created_at': datetime.datetime(2026, 6, 24, 2, 36, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 36, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f61db0d1-3d8c-4e5a-bfaf-5493291c28d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76ae4230>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52110216-de17-419e-bce7-a9073834147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:52 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Volume volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c (99aca951-daf1-4d7b-a09d-6bf3f1d28c7c): created successfully
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52110216-de17-419e-bce7-a9073834147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Flow 'volume_create_manager' (4f73ad14-dd92-44d0-a807-fbba65930ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:52 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2816fc8f-b7c8-48eb-ac0d-1bde74bd41c4 tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Created volume successfully.
Jun 24 04:36:52 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071" returned: 0 in 0.778s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.652s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-385992358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e742304f-334b-4ef3-a443-502caf4b78b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de04dd8ad0346319b118afb0781aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:46Z,use_quota=True,user_id='ada70960f3024e67bd0c122a08483a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Creating volume e742304f-334b-4ef3-a443-502caf4b78b2 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:52 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Acquiring lock "cinder-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6490d975-706e-4d0a-b3a1-7ff37f446841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74acdea7-d084-4fb9-a89b-06f3b9048071', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:52 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17686c1a-4eb3-43b4-9b99-5e0b5af1f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:52 devstack sudo[113927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2 1073741824
Jun 24 04:36:52 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:52 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume volume-74acdea7-d084-4fb9-a89b-06f3b9048071 (74acdea7-d084-4fb9-a89b-06f3b9048071): created successfully
Jun 24 04:36:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17686c1a-4eb3-43b4-9b99-5e0b5af1f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:53 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (e1f1e4fb-f706-4a70-adfa-b86c3714c285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "cinder-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:53 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4ffc8230-99ae-46ba-9990-2c094ad2c27a tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created volume successfully.
Jun 24 04:36:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Acquiring lock "cinder-quobyte-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "cinder-quobyte-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e64380-68c6-4e9a-94fb-df6ce591dcfe]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:53 devstack sudo[113929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c
Jun 24 04:36:53 devstack sudo[113929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:53 devstack sudo[113929]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" returned: 0 in 0.883s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:54 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2 1073741824" returned: 0 in 1.105s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:54 devstack sudo[113938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2
Jun 24 04:36:54 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:54 devstack sudo[113937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c
Jun 24 04:36:54 devstack sudo[113937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:54 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2" returned: 0 in 0.724s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.583s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-145371093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e26badf-cd6a-4090-8fc0-e298144caf67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56457270b55d4a1ea020bb89d595ccd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:50Z,use_quota=True,user_id='ac23ddd3afe84610b2c89fcb87ed72cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Creating volume 0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:54 devstack sudo[113937]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:36:54 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" returned: 1 in 0.840s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:54 devstack sudo[113945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 1073741824
Jun 24 04:36:54 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bd209e-8a09-400c-ade3-ce735f647ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e742304f-334b-4ef3-a443-502caf4b78b2', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b63ff9b-f09f-40ff-8b37-c9ed9e52080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:54 devstack sudo[113946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c
Jun 24 04:36:54 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:54 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Volume volume-e742304f-334b-4ef3-a443-502caf4b78b2 (e742304f-334b-4ef3-a443-502caf4b78b2): created successfully
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b63ff9b-f09f-40ff-8b37-c9ed9e52080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:54 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Flow 'volume_create_manager' (9ca23aca-3127-4f58-89b3-fd6a61465b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:54 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-20b2c92a-be5e-4db3-9b38-b9b9c26be01e tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created volume successfully.
Jun 24 04:36:55 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" returned: 0 in 0.743s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "cinder-quobyte-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c" released by "delete_volume" :: held 2.534s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Created reservations ['c6cce2b2-6b17-44e8-9c0a-ac8df0fa98c0', '2ef54690-1653-4347-b30a-d17fdf3e6d84', '257cd06f-6845-450b-826d-da1ad62d3a45', '6eb90a69-79a8-400b-b003-08cfbd0d84c4'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:55 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 1073741824" returned: 0 in 0.932s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:55 devstack sudo[113954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:55 devstack sudo[113954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:55 devstack sudo[113956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67
Jun 24 04:36:55 devstack sudo[113956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-e742304f-334b-4ef3-a443-502caf4b78b2-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-e742304f-334b-4ef3-a443-502caf4b78b2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-quobyte-e742304f-334b-4ef3-a443-502caf4b78b2" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-e742304f-334b-4ef3-a443-502caf4b78b2" acquired by "delete_volume" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3bd3f8-3fa5-4d21-8c4a-899a29d60e2d]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:56 devstack sudo[113964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2
Jun 24 04:36:56 devstack sudo[113964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:56 devstack sudo[113954]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.893s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Deleted volume successfully.
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-37fbb5c0-6528-463d-a895-f413ea1ae15a tempest-VolumeAndVolumeTypeFromImageTest-1749663628 None] Lock "cinder-99aca951-daf1-4d7b-a09d-6bf3f1d28c7c-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:56 devstack sudo[113956]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67" returned: 0 in 0.960s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60f65b8-d819-4289-8b14-ec270048cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e26badf-cd6a-4090-8fc0-e298144caf67', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ffe21c-726d-4e80-8e53-77fbd861d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:56 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Volume volume-0e26badf-cd6a-4090-8fc0-e298144caf67 (0e26badf-cd6a-4090-8fc0-e298144caf67): created successfully
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ffe21c-726d-4e80-8e53-77fbd861d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:56 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Flow 'volume_create_manager' (4b66effa-1f45-418f-9ab2-b82276d73f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-9c54003c-92cc-4d2e-a667-8847b090bf48 tempest-SnapshotDependencyTests-2019949350 None] Created volume successfully.
Jun 24 04:36:57 devstack sudo[113964]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2" returned: 0 in 0.981s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:57 devstack sudo[113973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2
Jun 24 04:36:57 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:57 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e742304f-334b-4ef3-a443-502caf4b78b2" returned: 0 in 0.737s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-e742304f-334b-4ef3-a443-502caf4b78b2" released by "delete_volume" :: held 1.790s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:57 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:36:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Flow 'volume_create_manager' (2cdf9cda-5287-4da0-a1df-cae71fe38626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:36:57 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b90ea7-c92e-41e5-92a3-53dd38d991fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created reservations ['dd0af342-5485-4864-af0d-95a3349d7cbf', '0f39b7c5-341a-469d-96af-b82b3e83c1f2', 'e8847765-fa33-48f2-aa5e-994f87d8c0c5', 'cabbf3db-dcf1-4629-b14d-b673246cae16'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b90ea7-c92e-41e5-92a3-53dd38d991fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caaf879c-6066-4937-ba98-f4caa6a46cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e91703f705a4b59b7233b314e51f0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:58Z,use_quota=True,user_id='7d6fcbec218d459dac177a4bd46ba2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fac8cb-3c5e-4847-aef3-0d2d04ab66a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fac8cb-3c5e-4847-aef3-0d2d04ab66a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8808b920-40d3-42f8-9787-0c947137623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.image.glance [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Creating Keystone auth plugin from conf {{(pid=93470) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Creating offline snapshot d9eac867-bb3c-48c1-ac66-5755eaa97c6f of volume 0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f240be-1291-4fd3-a10b-45bb5fefc09d]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-74acdea7-d084-4fb9-a89b-06f3b9048071-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:58 devstack sudo[113977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:36:58 devstack sudo[113977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-74acdea7-d084-4fb9-a89b-06f3b9048071-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:58 devstack sudo[113976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67
Jun 24 04:36:58 devstack sudo[113976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-quobyte-74acdea7-d084-4fb9-a89b-06f3b9048071" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-74acdea7-d084-4fb9-a89b-06f3b9048071" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be8eed6-bce0-42bc-9a17-1bb08264e3f4]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:58 devstack sudo[113980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071
Jun 24 04:36:58 devstack sudo[113980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8808b920-40d3-42f8-9787-0c947137623d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'caaf879c-6066-4937-ba98-f4caa6a46cd8', 'volume_name': 'volume-caaf879c-6066-4937-ba98-f4caa6a46cd8', 'volume_size': 1, 'image_id': 'fdb22ec3-de0e-4985-845b-87b74d400d59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdb22ec3-de0e-4985-845b-87b74d400d59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f48d78874107ada355bc00cec27b1ced', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e91703f705a4b59b7233b314e51f0a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c010c025b286e590186bf30381c648fa801eaf147ddd55dc8adcf996f760338d48c7ada7653e01cfdc98148fe8ea99d82c542b5698603bffcf587dadc8ef32f2', 'id': 'fdb22ec3-de0e-4985-845b-87b74d400d59', 'created_at': datetime.datetime(2026, 6, 24, 2, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdb22ec3-de0e-4985-845b-87b74d400d59/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76c635f0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd4e920-f4ca-4da6-9d79-7a27effc8bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd4e920-f4ca-4da6-9d79-7a27effc8bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2b6be3-c955-47c1-9946-74e1f0e3fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:36:59 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Volume caaf879c-6066-4937-ba98-f4caa6a46cd8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-caaf879c-6066-4937-ba98-f4caa6a46cd8', 'volume_size': 1, 'image_id': 'fdb22ec3-de0e-4985-845b-87b74d400d59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdb22ec3-de0e-4985-845b-87b74d400d59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f48d78874107ada355bc00cec27b1ced', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e91703f705a4b59b7233b314e51f0a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c010c025b286e590186bf30381c648fa801eaf147ddd55dc8adcf996f760338d48c7ada7653e01cfdc98148fe8ea99d82c542b5698603bffcf587dadc8ef32f2', 'id': 'fdb22ec3-de0e-4985-845b-87b74d400d59', 'created_at': datetime.datetime(2026, 6, 24, 2, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdb22ec3-de0e-4985-845b-87b74d400d59/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76c635f0>}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Trying to clone caaf879c-6066-4937-ba98-f4caa6a46cd8 from image fdb22ec3-de0e-4985-845b-87b74d400d59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fdb22ec3-de0e-4985-845b-87b74d400d59', 'metadata': {}}]). {{(pid=93470) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:36:59 devstack sudo[113977]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.988s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:36:59 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Deleted volume successfully.
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-bef428cb-35f9-4ae0-8533-abdf449c5092 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-e742304f-334b-4ef3-a443-502caf4b78b2-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:36:59 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Image download 0.00 MB at 0.00 MB/s
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[433226a5-66f8-4b66-aad1-6887decd9177]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:59 devstack sudo[113976]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67" returned: 0 in 1.311s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:59 devstack sudo[113990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f 1G
Jun 24 04:36:59 devstack sudo[113990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:59 devstack sudo[113986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD
Jun 24 04:36:59 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:36:59 devstack sudo[113980]: pam_unix(sudo:session): session closed for user root
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071" returned: 0 in 1.180s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:36:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:36:59 devstack sudo[113993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071
Jun 24 04:36:59 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:00 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD" returned: 0 in 0.983s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:00 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-74acdea7-d084-4fb9-a89b-06f3b9048071" returned: 0 in 0.816s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-74acdea7-d084-4fb9-a89b-06f3b9048071" released by "delete_volume" :: held 2.052s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:00 devstack sudo[113990]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f 1G" returned: 0 in 1.000s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e26badf-cd6a-4090-8fc0-e298144caf67 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:00 devstack sudo[114002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD
Jun 24 04:37:00 devstack sudo[114002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:00 devstack sudo[114003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e26badf-cd6a-4090-8fc0-e298144caf67 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f
Jun 24 04:37:00 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created reservations ['5c2b806f-aed4-4a24-9803-485664bbe6b9', '4fcc4c6c-7141-470d-8edc-1f823093eb34', 'de75978c-bcfc-43d9-802f-c4485c977368', '5fa8e9a8-aea3-49a2-9c2a-a06323a2391b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:00 devstack sudo[114006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:00 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:01 devstack sudo[114002]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD" returned: 1 in 0.932s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Temporary image fdb22ec3-de0e-4985-845b-87b74d400d59 is fetched for user 7d6fcbec218d459dac177a4bd46ba2b4. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00210b7-52f7-4dfe-862f-074b402a4f0a]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:01 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e26badf-cd6a-4090-8fc0-e298144caf67 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f" returned: 0 in 0.937s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:01 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f is being set with open permissions: ugo+rw
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:01 devstack sudo[114018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f
Jun 24 04:37:01 devstack sudo[114018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:01 devstack sudo[114017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD
Jun 24 04:37:01 devstack sudo[114017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:01 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.760s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:01 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Deleted volume successfully.
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-84bf3821-298e-48bd-9028-6a668e6569c1 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-74acdea7-d084-4fb9-a89b-06f3b9048071-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-95ad0c2f-9aee-4eca-9627-e02dab70b44a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-95ad0c2f-9aee-4eca-9627-e02dab70b44a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-quobyte-95ad0c2f-9aee-4eca-9627-e02dab70b44a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-95ad0c2f-9aee-4eca-9627-e02dab70b44a" acquired by "delete_volume" :: waited 0.031s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[610261a2-a3c2-4867-a1fa-6167e451c849]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:01 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:01 devstack sudo[114021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a
Jun 24 04:37:01 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Flow 'volume_create_manager' (1cf4f5c1-fade-4806-82ea-a54d87cfc9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601a243d-8c30-46bd-b4f7-fbf127268b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601a243d-8c30-46bd-b4f7-fbf127268b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1496388842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e116ca72-e2b6-46cc-b922-a28e5c395109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6a25752eb84dc9b63747ee003b89ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:02Z,use_quota=True,user_id='865a1c3092dd4ecd945d8db2bc1b5654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2772cb-8f44-4657-8451-0cd9aecf5203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2772cb-8f44-4657-8451-0cd9aecf5203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8788e0-324d-46f5-ae09-a576042301f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8788e0-324d-46f5-ae09-a576042301f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e116ca72-e2b6-46cc-b922-a28e5c395109', 'volume_name': 'volume-e116ca72-e2b6-46cc-b922-a28e5c395109', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08f5489-515d-4a32-94ca-0359860f72e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08f5489-515d-4a32-94ca-0359860f72e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b916b357-1441-4285-8ca7-5d56b09b1061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:02 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Volume e116ca72-e2b6-46cc-b922-a28e5c395109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e116ca72-e2b6-46cc-b922-a28e5c395109', 'volume_size': 1}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:02 devstack sudo[114018]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f" returned: 0 in 0.802s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:02 devstack sudo[114026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.info
Jun 24 04:37:02 devstack sudo[114026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:02 devstack sudo[114017]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD" returned: 0 in 0.918s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:02 devstack sudo[114028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD
Jun 24 04:37:02 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:02 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a" returned: 0 in 0.909s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:02 devstack sudo[114035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a
Jun 24 04:37:02 devstack sudo[114035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:02 devstack sudo[114026]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.info" returned: 0 in 0.699s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:02 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.info is being set with open permissions: ugo+rw
Jun 24 04:37:02 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:02 devstack sudo[114037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.info
Jun 24 04:37:02 devstack sudo[114037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:03 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD" returned: 1 in 0.791s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:03 devstack sudo[114035]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-95ad0c2f-9aee-4eca-9627-e02dab70b44a" returned: 0 in 0.671s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-95ad0c2f-9aee-4eca-9627-e02dab70b44a" released by "delete_volume" :: held 1.646s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created reservations ['1dc594b2-eb75-4724-ab3f-197d7d3fe86f', '46225d3b-edca-485f-8c96-f742609e4154', 'b3a0bae0-d8ac-4367-b106-2cc9e4945c9f', '414035ee-6de8-4594-87d1-790e314bab6d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:03 devstack sudo[114037]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.info" returned: 0 in 0.681s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:03 devstack sudo[114044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:03 devstack sudo[114044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.549s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1496388842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e116ca72-e2b6-46cc-b922-a28e5c395109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6a25752eb84dc9b63747ee003b89ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:02Z,use_quota=True,user_id='865a1c3092dd4ecd945d8db2bc1b5654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Creating volume e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:03 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:03 devstack sudo[114046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 1073741824
Jun 24 04:37:03 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:03 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d266e1af-d852-491d-b74e-19ae77d220de tempest-SnapshotDependencyTests-2019949350 None] Create snapshot completed successfully
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-40bb30e5-1eed-4105-84e4-b870c2252ed5-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:03 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-40bb30e5-1eed-4105-84e4-b870c2252ed5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-quobyte-40bb30e5-1eed-4105-84e4-b870c2252ed5" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-40bb30e5-1eed-4105-84e4-b870c2252ed5" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[685832a0-d19f-45ff-a0f4-fa5f6a6201a8]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:04 devstack sudo[114048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5
Jun 24 04:37:04 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:04 devstack sudo[114044]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.744s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:04 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Deleted volume successfully.
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c85ef6cc-dc60-4a6f-8760-6f2bbc1e067f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-95ad0c2f-9aee-4eca-9627-e02dab70b44a-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:04 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 1073741824" returned: 0 in 0.959s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:04 devstack sudo[114055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109
Jun 24 04:37:04 devstack sudo[114055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:04 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5" returned: 0 in 0.875s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:04 devstack sudo[114061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5
Jun 24 04:37:04 devstack sudo[114061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:04 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Flow 'volume_create_manager' (ad6cfdc4-3c65-4585-ab34-08251012c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5047a07-6e03-48dc-913e-9453421db501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5047a07-6e03-48dc-913e-9453421db501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb659c2d-ef4e-4dd5-9179-82985312f9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56457270b55d4a1ea020bb89d595ccd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9eac867-bb3c-48c1-ac66-5755eaa97c6f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:05Z,use_quota=True,user_id='ac23ddd3afe84610b2c89fcb87ed72cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299fedce-59cd-4f76-81e1-650f88a349c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299fedce-59cd-4f76-81e1-650f88a349c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a1ad37-04f6-4bb9-b5cd-e5a9e019faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a1ad37-04f6-4bb9-b5cd-e5a9e019faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb659c2d-ef4e-4dd5-9179-82985312f9fd', 'volume_name': 'volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd', 'volume_size': 1, 'snapshot_id': 'd9eac867-bb3c-48c1-ac66-5755eaa97c6f'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b05703-3a1d-4934-92c3-10d4ff056bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b05703-3a1d-4934-92c3-10d4ff056bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee07b5f-7508-42bc-9965-f6961421b8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:05 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Volume bb659c2d-ef4e-4dd5-9179-82985312f9fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd', 'volume_size': 1, 'snapshot_id': 'd9eac867-bb3c-48c1-ac66-5755eaa97c6f'}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:05 devstack sudo[114055]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109" returned: 0 in 0.746s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caaf879c-6066-4937-ba98-f4caa6a46cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e91703f705a4b59b7233b314e51f0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:36:58Z,use_quota=True,user_id='7d6fcbec218d459dac177a4bd46ba2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Creating volume caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:05 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b916b357-1441-4285-8ca7-5d56b09b1061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e116ca72-e2b6-46cc-b922-a28e5c395109', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:05 devstack sudo[114066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 1073741824
Jun 24 04:37:05 devstack sudo[114066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f276e8d-4dc8-4f76-a72b-947d9916d62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:05 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Volume volume-e116ca72-e2b6-46cc-b922-a28e5c395109 (e116ca72-e2b6-46cc-b922-a28e5c395109): created successfully
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f276e8d-4dc8-4f76-a72b-947d9916d62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Flow 'volume_create_manager' (1cf4f5c1-fade-4806-82ea-a54d87cfc9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:05 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-aec995d3-2002-45fa-8efe-a42bf734118e tempest-VolumeDependencyTests-1155910176 None] Created volume successfully.
Jun 24 04:37:05 devstack sudo[114061]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-40bb30e5-1eed-4105-84e4-b870c2252ed5" returned: 0 in 0.699s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-40bb30e5-1eed-4105-84e4-b870c2252ed5" released by "delete_volume" :: held 1.617s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created reservations ['652792b4-f688-4091-b6a0-a9a58a5ad819', '487ef761-ba60-42ad-8681-bc3394ba91dc', '28e17369-4ee4-437d-9490-dfbcf8442061', 'ca780779-81f2-49f2-b44b-0f0bad49f87b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:05 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:05 devstack sudo[114069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:05 devstack sudo[114069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-192a2f09-a4d0-4c91-bc4e-91125f151950-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:06 devstack sudo[114066]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-192a2f09-a4d0-4c91-bc4e-91125f151950-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 1073741824" returned: 0 in 0.903s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-quobyte-192a2f09-a4d0-4c91-bc4e-91125f151950" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:06 devstack sudo[114075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8
Jun 24 04:37:06 devstack sudo[114075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-192a2f09-a4d0-4c91-bc4e-91125f151950" acquired by "delete_volume" :: waited 0.031s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09578b7-016c-45fa-8e73-c0c02c27e896]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:06 devstack sudo[114069]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.738s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:06 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Deleted volume successfully.
Jun 24 04:37:06 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-d289a7c4-19b8-43bf-ab89-334692ceb50d tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-40bb30e5-1eed-4105-84e4-b870c2252ed5-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:06 devstack sudo[114079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950
Jun 24 04:37:06 devstack sudo[114079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:07 devstack sudo[114075]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8" returned: 0 in 0.727s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.949s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-quobyte-d9eac867-bb3c-48c1-ac66-5755eaa97c6f-bb659c2d-ef4e-4dd5-9179-82985312f9fd" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-d9eac867-bb3c-48c1-ac66-5755eaa97c6f-bb659c2d-ef4e-4dd5-9179-82985312f9fd" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Creating volume bb659c2d-ef4e-4dd5-9179-82985312f9fd from snapshot d9eac867-bb3c-48c1-ac66-5755eaa97c6f {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-quobyte-bb659c2d-ef4e-4dd5-9179-82985312f9fd" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Attempting download of fdb22ec3-de0e-4985-845b-87b74d400d59 ((None, [{'url': 'file:///opt/stack/data/glance/images/fdb22ec3-de0e-4985-845b-87b74d400d59', 'metadata': {}}])) to volume caaf879c-6066-4937-ba98-f4caa6a46cd8. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-bb659c2d-ef4e-4dd5-9179-82985312f9fd" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] snapshot: d9eac867-bb3c-48c1-ac66-5755eaa97c6f, volume: bb659c2d-ef4e-4dd5-9179-82985312f9fd,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfad5154-afc9-499c-85bd-870f3ee03733]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6f7ebc-4e13-452e-915d-3ac9c834ec75]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdb22ec3-de0e-4985-845b-87b74d400d59_7o9zdqwz {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:07 devstack sudo[114079]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950" returned: 0 in 0.807s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:07 devstack sudo[114087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950
Jun 24 04:37:07 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:07 devstack sudo[114085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f
Jun 24 04:37:07 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:07 devstack sudo[114086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdb22ec3-de0e-4985-845b-87b74d400d59_7o9zdqwz
Jun 24 04:37:07 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:07 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdb22ec3-de0e-4985-845b-87b74d400d59_7o9zdqwz" returned: 0 in 0.757s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:07 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdb22ec3-de0e-4985-845b-87b74d400d59_7o9zdqwz {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:07 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-192a2f09-a4d0-4c91-bc4e-91125f151950" returned: 0 in 0.736s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-192a2f09-a4d0-4c91-bc4e-91125f151950" released by "delete_volume" :: held 1.624s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:08 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f" returned: 0 in 0.839s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e26badf-cd6a-4090-8fc0-e298144caf67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd3a189-5131-488b-a762-c91fd00fa543]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created reservations ['87c4eb3e-4a14-4265-9b6b-c74ee9f7fd5f', 'cb38d318-b5ca-45d6-8f2a-3017671bc638', 'de91f9d4-c0cf-4432-af4f-a507f5cefae3', '8b0e8f7f-d3de-4b0a-afff-90843781d12d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:08 devstack sudo[114097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdb22ec3-de0e-4985-845b-87b74d400d59_7o9zdqwz
Jun 24 04:37:08 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:08 devstack sudo[114098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67
Jun 24 04:37:08 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:08 devstack sudo[114100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:08 devstack sudo[114100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-1fb40b1d-d79d-4d4e-9e4b-4273fe892090-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-1fb40b1d-d79d-4d4e-9e4b-4273fe892090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-quobyte-35c0fc52-de16-4c07-8de5-f471e67726b5" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-35c0fc52-de16-4c07-8de5-f471e67726b5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-quobyte-1fb40b1d-d79d-4d4e-9e4b-4273fe892090" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-1fb40b1d-d79d-4d4e-9e4b-4273fe892090" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Deleting offline snapshot 1fb40b1d-d79d-4d4e-9e4b-4273fe892090 of volume 35c0fc52-de16-4c07-8de5-f471e67726b5 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] snapshot_file for this snap is: volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd6b017-7b9c-4a69-b3e1-792ca4c40bc2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:08 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:08 devstack sudo[114103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdb22ec3-de0e-4985-845b-87b74d400d59_7o9zdqwz" returned: 1 in 0.836s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdb22ec3-de0e-4985-845b-87b74d400d59_7o9zdqwz' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:37:08 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b71aa5-d22f-4d71-b0c8-9504ee019dcd]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:08 devstack sudo[114100]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.724s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:08 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Deleted volume successfully.
Jun 24 04:37:08 devstack sudo[114111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD
Jun 24 04:37:08 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:08 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6abfba15-bc82-41b0-81c7-ffc5f7c48d13 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-192a2f09-a4d0-4c91-bc4e-91125f151950-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67" returned: 0 in 0.901s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:37:08 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:09 devstack sudo[114113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd
Jun 24 04:37:09 devstack sudo[114113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:09 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090" returned: 0 in 0.877s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:09 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35c0fc52-de16-4c07-8de5-f471e67726b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:37:09 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6306804-ddf1-414d-ba3d-b6b95b6f9ba7]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:09 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:09 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:09 devstack sudo[114124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5
Jun 24 04:37:09 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:09 devstack sudo[114125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD
Jun 24 04:37:09 devstack sudo[114125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:11 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5" returned: 0 in 1.516s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:11 devstack sudo[114125]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD" returned: 1 in 1.510s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:37:11 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] fdb22ec3-de0e-4985-845b-87b74d400d59 was raw, converting to raw {{(pid=93470) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:37:11 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:11 devstack sudo[114143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8
Jun 24 04:37:11 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:11 devstack sudo[114142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090
Jun 24 04:37:11 devstack sudo[114142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:12 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8" returned: 0 in 1.340s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:12 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fdb22ec3-de0e-4985-845b-87b74d400d59_oj2nu7dxdevstack@QuobyteHD, size 0.00 MB, duration 1.34 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:37:12 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Converted 0.00 MB image at 0.00 MB/s
Jun 24 04:37:12 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:12 devstack sudo[114149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 1G
Jun 24 04:37:12 devstack sudo[114149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:13 devstack sudo[114142]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090" returned: 0 in 2.259s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:13 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:13 devstack sudo[114154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090
Jun 24 04:37:13 devstack sudo[114154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:14 devstack sudo[114149]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 1G" returned: 0 in 1.711s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[174df2dd-a895-4a4e-aca5-1dedb90561f8]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:14 devstack sudo[114159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8
Jun 24 04:37:14 devstack sudo[114159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:14 devstack sudo[114154]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5.1fb40b1d-d79d-4d4e-9e4b-4273fe892090" returned: 0 in 1.469s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-1fb40b1d-d79d-4d4e-9e4b-4273fe892090" released by "_delete_snapshot" :: held 6.291s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-35c0fc52-de16-4c07-8de5-f471e67726b5" released by "delete_snapshot" :: held 6.315s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:14 devstack sudo[114113]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd" returned: 0 in 5.971s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9358b6-6ef9-4e8d-a6d6-54439d7cc7c2]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:14 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:15 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created reservations ['b9f62e4b-43a2-4a6d-98cb-d2ef918f0477', '670a3278-92ef-4190-b1b9-a97350fe180d', 'aa5630e9-d733-427f-8651-725da82ab798', 'a7562079-39bb-4f16-9476-27fa8ed0687d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:15 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Delete snapshot completed successfully.
Jun 24 04:37:15 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-6fdd9c9b-66f1-4675-b0f3-15c1418fb641 tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-1fb40b1d-d79d-4d4e-9e4b-4273fe892090-delete_snapshot" released by "delete_snapshot" :: held 6.491s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:15 devstack sudo[114162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67
Jun 24 04:37:15 devstack sudo[114162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:15 devstack sudo[114159]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8" returned: 0 in 1.023s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:15 devstack sudo[114166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8
Jun 24 04:37:15 devstack sudo[114166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:15 devstack sudo[114162]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67" returned: 0 in 0.956s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:15 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:37:15 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Converted 1024.00 MB image at 171.47 MB/s
Jun 24 04:37:15 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd is being set with open permissions: ugo+rw
Jun 24 04:37:15 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:15 devstack sudo[114171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd
Jun 24 04:37:15 devstack sudo[114171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-35c0fc52-de16-4c07-8de5-f471e67726b5-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-35c0fc52-de16-4c07-8de5-f471e67726b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:16 devstack sudo[114166]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8" returned: 1 in 0.806s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Downloaded image fdb22ec3-de0e-4985-845b-87b74d400d59 ((None, [{'url': 'file:///opt/stack/data/glance/images/fdb22ec3-de0e-4985-845b-87b74d400d59', 'metadata': {}}])) to volume caaf879c-6066-4937-ba98-f4caa6a46cd8 successfully. {{(pid=93470) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Temporary image fdb22ec3-de0e-4985-845b-87b74d400d59 for user 7d6fcbec218d459dac177a4bd46ba2b4 is deleted. {{(pid=93470) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.volume_utils [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Marking volume caaf879c-6066-4937-ba98-f4caa6a46cd8 as bootable. {{(pid=93470) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "cinder-quobyte-35c0fc52-de16-4c07-8de5-f471e67726b5" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Copying metadata from image fdb22ec3-de0e-4985-845b-87b74d400d59 to caaf879c-6066-4937-ba98-f4caa6a46cd8. {{(pid=93470) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Creating volume glance metadata for volume caaf879c-6066-4937-ba98-f4caa6a46cd8 backed by image fdb22ec3-de0e-4985-845b-87b74d400d59 with: {'image_id': 'fdb22ec3-de0e-4985-845b-87b74d400d59', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f48d78874107ada355bc00cec27b1ced', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93470) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-35c0fc52-de16-4c07-8de5-f471e67726b5" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ce938-94c0-4e63-82e4-53c1ef16ec42]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2b6be3-c955-47c1-9946-74e1f0e3fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caaf879c-6066-4937-ba98-f4caa6a46cd8', 'volume_size': 1, 'image_id': 'fdb22ec3-de0e-4985-845b-87b74d400d59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdb22ec3-de0e-4985-845b-87b74d400d59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f48d78874107ada355bc00cec27b1ced', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e91703f705a4b59b7233b314e51f0a1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c010c025b286e590186bf30381c648fa801eaf147ddd55dc8adcf996f760338d48c7ada7653e01cfdc98148fe8ea99d82c542b5698603bffcf587dadc8ef32f2', 'id': 'fdb22ec3-de0e-4985-845b-87b74d400d59', 'created_at': datetime.datetime(2026, 6, 24, 2, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 36, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdb22ec3-de0e-4985-845b-87b74d400d59/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ceb76c635f0>}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49d0a0d-83c2-466a-8b3a-dba52fc95f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:16 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Volume volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 (caaf879c-6066-4937-ba98-f4caa6a46cd8): created successfully
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49d0a0d-83c2-466a-8b3a-dba52fc95f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Flow 'volume_create_manager' (2cdf9cda-5287-4da0-a1df-cae71fe38626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:16 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-23932bb6-6bd8-4739-a563-436303c3062d tempest-VolumeImageDependencyTests-2049679124 None] Created volume successfully.
Jun 24 04:37:16 devstack sudo[114176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5
Jun 24 04:37:16 devstack sudo[114176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Acquiring lock "cinder-caaf879c-6066-4937-ba98-f4caa6a46cd8-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Lock "cinder-caaf879c-6066-4937-ba98-f4caa6a46cd8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Acquiring lock "cinder-quobyte-caaf879c-6066-4937-ba98-f4caa6a46cd8" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Lock "cinder-quobyte-caaf879c-6066-4937-ba98-f4caa6a46cd8" acquired by "delete_volume" :: waited 0.016s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83956c5-17bf-4b7c-bccd-1fc772cfcf11]: (4, 'raw') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:16 devstack sudo[114171]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd" returned: 0 in 0.746s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-bb659c2d-ef4e-4dd5-9179-82985312f9fd" released by "_copy_volume_from_snapshot" :: held 9.545s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-d9eac867-bb3c-48c1-ac66-5755eaa97c6f-bb659c2d-ef4e-4dd5-9179-82985312f9fd" released by "_create_volume_from_snapshot" :: held 9.583s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.619s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.225s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Creating offline snapshot 2a5c1ffb-c711-49fd-a08c-7d11947afc3f of volume e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee07b5f-7508-42bc-9965-f6961421b8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd', 'volume_size': 1, 'snapshot_id': 'd9eac867-bb3c-48c1-ac66-5755eaa97c6f'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7bf37f-c775-4adb-8269-8a29fb8e2f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d0945a-471f-48ca-849a-2cd6181bb8c4]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:16 devstack sudo[114180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8
Jun 24 04:37:16 devstack sudo[114180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:16 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Volume volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd (bb659c2d-ef4e-4dd5-9179-82985312f9fd): created successfully
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7bf37f-c775-4adb-8269-8a29fb8e2f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:16 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Flow 'volume_create_manager' (ad6cfdc4-3c65-4585-ab34-08251012c66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:16 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-4e7b69b2-a9c4-420e-b096-d4b1d283a92f tempest-SnapshotDependencyTests-2019949350 None] Created volume successfully.
Jun 24 04:37:16 devstack sudo[114181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109
Jun 24 04:37:16 devstack sudo[114181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:17 devstack sudo[114176]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5" returned: 0 in 0.815s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:17 devstack sudo[114187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5
Jun 24 04:37:17 devstack sudo[114187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-d9eac867-bb3c-48c1-ac66-5755eaa97c6f-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-d9eac867-bb3c-48c1-ac66-5755eaa97c6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-quobyte-0e26badf-cd6a-4090-8fc0-e298144caf67" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-0e26badf-cd6a-4090-8fc0-e298144caf67" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-quobyte-d9eac867-bb3c-48c1-ac66-5755eaa97c6f" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-d9eac867-bb3c-48c1-ac66-5755eaa97c6f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Deleting offline snapshot d9eac867-bb3c-48c1-ac66-5755eaa97c6f of volume 0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] snapshot_file for this snap is: volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2235480a-c42e-40a4-aa6a-e54a691c34d0]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:17 devstack sudo[114189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f
Jun 24 04:37:17 devstack sudo[114189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:17 devstack sudo[114180]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8" returned: 0 in 0.837s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:17 devstack sudo[114196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8
Jun 24 04:37:17 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:17 devstack sudo[114181]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109" returned: 0 in 0.865s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:17 devstack sudo[114199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f 1G
Jun 24 04:37:17 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:17 devstack sudo[114187]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-35c0fc52-de16-4c07-8de5-f471e67726b5" returned: 0 in 0.812s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-quobyte-35c0fc52-de16-4c07-8de5-f471e67726b5" released by "delete_volume" :: held 1.686s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Created reservations ['d44b4e31-48f1-4a33-8221-fd02bb44bd28', '7b140989-7e12-4c5f-9939-faa530356cb8', '2d2fd4ff-2395-41e3-93de-a0f7b02d249b', '21a26c54-314e-4341-9278-948f88968a7d'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:17 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:18 devstack sudo[114204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:18 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:18 devstack sudo[114189]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f" returned: 0 in 0.900s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e26badf-cd6a-4090-8fc0-e298144caf67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf64c25-bf41-452e-87a8-a3434531b7f7]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:18 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8" returned: 1 in 0.825s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8' failed. Not Retrying. {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:18 devstack sudo[114214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8
Jun 24 04:37:18 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:18 devstack sudo[114210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67
Jun 24 04:37:18 devstack sudo[114210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:18 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f 1G" returned: 0 in 0.981s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e116ca72-e2b6-46cc-b922-a28e5c395109 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:18 devstack sudo[114218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e116ca72-e2b6-46cc-b922-a28e5c395109 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f
Jun 24 04:37:18 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:18 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.810s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:18 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Deleted volume successfully.
Jun 24 04:37:18 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2f6cab3e-dda6-428d-a1a9-5d74123d965f tempest-CreateVolumesFromSnapshotTest-2042230120 None] Lock "cinder-35c0fc52-de16-4c07-8de5-f471e67726b5-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:19 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-caaf879c-6066-4937-ba98-f4caa6a46cd8" returned: 0 in 0.854s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:19 devstack sudo[114210]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67" returned: 0 in 0.966s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Lock "cinder-quobyte-caaf879c-6066-4937-ba98-f4caa6a46cd8" released by "delete_volume" :: held 2.588s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:19 devstack sudo[114225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f
Jun 24 04:37:19 devstack sudo[114225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Created reservations ['ac3b3ba1-ce71-4aee-a05a-485e4bf0ee71', '6e581a0e-c2be-476e-b0f6-cea5fc5666a3', '81e948a3-f440-4544-92fc-30fc787d89a4', '2c2e4dfc-9a4a-458a-a2b7-ab416b6ec166'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:19 devstack sudo[114232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:19 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:19 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e116ca72-e2b6-46cc-b922-a28e5c395109 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f" returned: 0 in 0.935s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:19 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f is being set with open permissions: ugo+rw
Jun 24 04:37:19 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:19 devstack sudo[114234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f
Jun 24 04:37:19 devstack sudo[114234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:20 devstack sudo[114225]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f" returned: 0 in 1.155s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:20 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.993s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:20 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:20 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Deleted volume successfully.
Jun 24 04:37:20 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=128,cinder:UPDATE=178,cinder:INSERT=50,cinder:DELETE=12 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:37:20 devstack sudo[114241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f
Jun 24 04:37:20 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:20 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ab893493-26c2-4ea6-8ede-cffff5eed6cc tempest-VolumeImageDependencyTests-2049679124 None] Lock "cinder-caaf879c-6066-4937-ba98-f4caa6a46cd8-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:20 devstack sudo[114234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f" returned: 0 in 0.930s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:20 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:20 devstack sudo[114243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.info
Jun 24 04:37:20 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:21 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67.d9eac867-bb3c-48c1-ac66-5755eaa97c6f" returned: 0 in 0.815s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:21 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:UPDATE=149,cinder:SELECT=120,cinder:DELETE=19,cinder:INSERT=42 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:37:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-d9eac867-bb3c-48c1-ac66-5755eaa97c6f" released by "_delete_snapshot" :: held 4.025s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-0e26badf-cd6a-4090-8fc0-e298144caf67" released by "delete_snapshot" :: held 4.058s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:21 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Created reservations ['65d50622-7976-4717-8622-6a8bd3b21b64', '6ee88cb2-c78d-4227-8de8-aae76e813e3b', '4b5fb6e7-20f6-4c0d-9bd4-034421352789', '2ba2c156-9cee-46f2-b3dd-0da88ec805c7'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:21 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Delete snapshot completed successfully.
Jun 24 04:37:21 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ee31fd83-efa1-459e-9a7e-bfd501f95336 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-d9eac867-bb3c-48c1-ac66-5755eaa97c6f-delete_snapshot" released by "delete_snapshot" :: held 4.267s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:21 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.info" returned: 0 in 1.061s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:21 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.info is being set with open permissions: ugo+rw
Jun 24 04:37:21 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:21 devstack sudo[114283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.info
Jun 24 04:37:21 devstack sudo[114283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:22 devstack sudo[114283]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.info" returned: 0 in 0.756s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.647s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:22 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e6330393-37ae-406c-a751-c734e0a2e5e8 tempest-VolumeDependencyTests-1155910176 None] Create snapshot completed successfully
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-0e26badf-cd6a-4090-8fc0-e298144caf67-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (f8c9571a-0757-42ee-a4bd-9a4766e860a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d505a3fb-ebc2-4b9e-abf3-a8254a3c892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-0e26badf-cd6a-4090-8fc0-e298144caf67-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d505a3fb-ebc2-4b9e-abf3-a8254a3c892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288713204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aacd79d4-16bd-497e-a971-aca11848754a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:22Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ffd2e7-0ac2-41f3-870c-51e84e832d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ffd2e7-0ac2-41f3-870c-51e84e832d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63f720f-2d1b-4344-b15d-4c61eb404df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63f720f-2d1b-4344-b15d-4c61eb404df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aacd79d4-16bd-497e-a971-aca11848754a', 'volume_name': 'volume-aacd79d4-16bd-497e-a971-aca11848754a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90385ef-5d8c-431a-b0c6-69dc59529fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90385ef-5d8c-431a-b0c6-69dc59529fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c5d602-e805-4f16-9a2b-a730824e1874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:22 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume aacd79d4-16bd-497e-a971-aca11848754a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aacd79d4-16bd-497e-a971-aca11848754a', 'volume_size': 1}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288713204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aacd79d4-16bd-497e-a971-aca11848754a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:22Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Creating volume aacd79d4-16bd-497e-a971-aca11848754a {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:22 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:22 devstack sudo[114286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a 1073741824
Jun 24 04:37:22 devstack sudo[114286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-quobyte-0e26badf-cd6a-4090-8fc0-e298144caf67" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-0e26badf-cd6a-4090-8fc0-e298144caf67" acquired by "delete_volume" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b63f1f-6788-401d-8bdf-1f6fb3048a73]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:22 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:22 devstack sudo[114288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67
Jun 24 04:37:22 devstack sudo[114288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:23 devstack sudo[114286]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a 1073741824" returned: 0 in 0.966s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:23 devstack sudo[114288]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67" returned: 0 in 0.862s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:23 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:23 devstack sudo[114297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67
Jun 24 04:37:23 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:23 devstack sudo[114298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a
Jun 24 04:37:23 devstack sudo[114298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Flow 'volume_create_manager' (493b9cdc-b688-4d97-aaf0-09084202408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb528faf-94b0-4a21-b7f2-e47c460f0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb528faf-94b0-4a21-b7f2-e47c460f0179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566ba819b3b74c73a576385cd2e169cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:24Z,use_quota=True,user_id='dc93816f6da04bfe9085092305d50043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fda5c55-a6a4-4fc5-8a2a-735851293f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fda5c55-a6a4-4fc5-8a2a-735851293f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc40d89-2f64-487d-8d64-35c50dada8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc40d89-2f64-487d-8d64-35c50dada8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3', 'volume_name': 'volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d946b96-3615-4304-a047-ed54403eb161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d946b96-3615-4304-a047-ed54403eb161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d151f3e-09f4-493d-a4ca-ffd6e59517dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Volume 6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3', 'volume_size': 1}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Flow 'volume_create_manager' (88570538-ea34-4d45-b680-be3df7988697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2cd6b2-408a-45f0-9ccf-48e2abd748d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack sudo[114298]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a" returned: 0 in 0.732s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:24 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.080s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566ba819b3b74c73a576385cd2e169cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:24Z,use_quota=True,user_id='dc93816f6da04bfe9085092305d50043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Creating volume 6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:24 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2cd6b2-408a-45f0-9ccf-48e2abd748d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-118355836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31482c6a-0610-4252-ad0a-ee1e045dabf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6a25752eb84dc9b63747ee003b89ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2a5c1ffb-c711-49fd-a08c-7d11947afc3f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:24Z,use_quota=True,user_id='865a1c3092dd4ecd945d8db2bc1b5654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f7f873-c753-4566-a169-17d899600483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack sudo[114303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3 1073741824
Jun 24 04:37:24 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f7f873-c753-4566-a169-17d899600483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93c02ea-2a1d-4662-9b59-0cdb0d9e4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93c02ea-2a1d-4662-9b59-0cdb0d9e4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31482c6a-0610-4252-ad0a-ee1e045dabf4', 'volume_name': 'volume-31482c6a-0610-4252-ad0a-ee1e045dabf4', 'volume_size': 1, 'snapshot_id': '2a5c1ffb-c711-49fd-a08c-7d11947afc3f'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f9444-7cac-4cae-94cd-f9c77a4a46c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f9444-7cac-4cae-94cd-f9c77a4a46c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba9d1ff-34fe-4e74-9005-79f6d01e4689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Volume 31482c6a-0610-4252-ad0a-ee1e045dabf4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31482c6a-0610-4252-ad0a-ee1e045dabf4', 'volume_size': 1, 'snapshot_id': '2a5c1ffb-c711-49fd-a08c-7d11947afc3f'}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-0e26badf-cd6a-4090-8fc0-e298144caf67" returned: 0 in 0.840s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c5d602-e805-4f16-9a2b-a730824e1874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aacd79d4-16bd-497e-a971-aca11848754a', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a205a6e8-e35d-41ce-a0da-afe11af5f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-0e26badf-cd6a-4090-8fc0-e298144caf67" released by "delete_volume" :: held 1.790s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:24 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume volume-aacd79d4-16bd-497e-a971-aca11848754a (aacd79d4-16bd-497e-a971-aca11848754a): created successfully
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a205a6e8-e35d-41ce-a0da-afe11af5f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (f8c9571a-0757-42ee-a4bd-9a4766e860a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:24 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-45e0110a-8418-42f9-a45e-17b2feb67542 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created volume successfully.
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Created reservations ['b2a19bcf-a756-4bfb-a296-9dea806cc9d1', '7eb02ed1-95b9-458f-b289-03f807238dac', 'b0fc5365-e6d5-4d0b-b2f1-2c437407c8d3', 'd77f0cd1-afa4-4698-8e35-6723c544a718'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:24 devstack sudo[114305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:24 devstack sudo[114305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-bb659c2d-ef4e-4dd5-9179-82985312f9fd-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:24 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-bb659c2d-ef4e-4dd5-9179-82985312f9fd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "cinder-quobyte-bb659c2d-ef4e-4dd5-9179-82985312f9fd" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-bb659c2d-ef4e-4dd5-9179-82985312f9fd" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e5df1-d78a-44cb-ae7f-3968a2726e32]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:25 devstack sudo[114310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd
Jun 24 04:37:25 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:25 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3 1073741824" returned: 0 in 0.989s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:25 devstack sudo[114305]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.850s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:25 devstack sudo[114316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3
Jun 24 04:37:25 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:25 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Deleted volume successfully.
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-593e3277-1619-4f00-883f-7f7646afeed1 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-0e26badf-cd6a-4090-8fc0-e298144caf67-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (aedc45c1-bfad-4159-a45e-41776d17e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f38086-4f7f-4b91-98aa-beb03a60574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f38086-4f7f-4b91-98aa-beb03a60574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893123306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e861b84f-a931-47c1-8ba6-98ca87fe1896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:26Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608f0bac-3703-4345-b61f-ad44c23eafaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608f0bac-3703-4345-b61f-ad44c23eafaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ea7f58-44da-4387-bff5-ab2ef47dd249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ea7f58-44da-4387-bff5-ab2ef47dd249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e861b84f-a931-47c1-8ba6-98ca87fe1896', 'volume_name': 'volume-e861b84f-a931-47c1-8ba6-98ca87fe1896', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ad4c44-c89a-4fed-b739-edb822ec1195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ad4c44-c89a-4fed-b739-edb822ec1195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d45491-fcc6-4ab6-ba44-5548d32c06bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume e861b84f-a931-47c1-8ba6-98ca87fe1896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e861b84f-a931-47c1-8ba6-98ca87fe1896', 'volume_size': 1}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (7fd8f1f3-86b9-46b2-8ef0-b8bc801bec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bc9b66-a358-456d-b306-e40d23060019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bc9b66-a358-456d-b306-e40d23060019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1312633332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3851a5a2-7693-4aae-95d1-5b2d28b6c2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:26Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63198fbb-7f46-4ea2-992a-4944abddca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63198fbb-7f46-4ea2-992a-4944abddca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a499a4-2cea-4437-a6a5-2f06f78a2fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a499a4-2cea-4437-a6a5-2f06f78a2fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3851a5a2-7693-4aae-95d1-5b2d28b6c2ec', 'volume_name': 'volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7468460-e005-49e9-8c97-6ed8add529ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7468460-e005-49e9-8c97-6ed8add529ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad25ead5-7cd5-4545-adbb-d33de2b4e05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:25 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume 3851a5a2-7693-4aae-95d1-5b2d28b6c2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec', 'volume_size': 1}
Jun 24 04:37:25 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:26 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd" returned: 0 in 0.996s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:26 devstack sudo[114321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd
Jun 24 04:37:26 devstack sudo[114321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (71bca2ab-b1cf-48d3-89c0-8ecdf5ed401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a027b73-6e12-4050-965b-e0514026e16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a027b73-6e12-4050-965b-e0514026e16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-193356142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fa89e1-8836-480b-b613-e5abbd290cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:26Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b65915-79a1-4521-8adc-f31930ad9bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b65915-79a1-4521-8adc-f31930ad9bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da1f6e0-a3d8-443a-acfd-81c2064a4076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da1f6e0-a3d8-443a-acfd-81c2064a4076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fa89e1-8836-480b-b613-e5abbd290cd7', 'volume_name': 'volume-f7fa89e1-8836-480b-b613-e5abbd290cd7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b5436b-eeb3-4332-a6d7-85e4b6f41d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b5436b-eeb3-4332-a6d7-85e4b6f41d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5b808d-7d66-4b89-9584-e282a226d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume f7fa89e1-8836-480b-b613-e5abbd290cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fa89e1-8836-480b-b613-e5abbd290cd7', 'volume_size': 1}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3" returned: 0 in 0.939s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.890s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-quobyte-2a5c1ffb-c711-49fd-a08c-7d11947afc3f-31482c6a-0610-4252-ad0a-ee1e045dabf4" by "_create_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d151f3e-09f4-493d-a4ca-ffd6e59517dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec3efd6-d1b8-418e-ba75-09144bc6baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-2a5c1ffb-c711-49fd-a08c-7d11947afc3f-31482c6a-0610-4252-ad0a-ee1e045dabf4" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Creating volume 31482c6a-0610-4252-ad0a-ee1e045dabf4 from snapshot 2a5c1ffb-c711-49fd-a08c-7d11947afc3f {{(pid=93470) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-quobyte-31482c6a-0610-4252-ad0a-ee1e045dabf4" by "_copy_volume_from_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:26 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Volume volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3 (6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3): created successfully
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec3efd6-d1b8-418e-ba75-09144bc6baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Flow 'volume_create_manager' (493b9cdc-b688-4d97-aaf0-09084202408f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-31482c6a-0610-4252-ad0a-ee1e045dabf4" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] snapshot: 2a5c1ffb-c711-49fd-a08c-7d11947afc3f, volume: 31482c6a-0610-4252-ad0a-ee1e045dabf4,  {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:37:26 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f1797d4a-7742-4eac-b61a-8819bc6f15dd tempest-CinderUnicodeTest-686188375 None] Created volume successfully.
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c16f0-e6d9-40a0-a255-b2c1ce3d6c8f]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:26 devstack sudo[114325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f
Jun 24 04:37:26 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (ed313f2f-e052-4ff9-8771-b341cd52d5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96ea86b-b552-4595-b306-53343086197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96ea86b-b552-4595-b306-53343086197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-772832736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807f1ef1-34e5-433a-8956-6fb376bb86f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:27Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d36bc5f-f59d-4458-b3c4-8c0cb8c0005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d36bc5f-f59d-4458-b3c4-8c0cb8c0005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada132d5-7c60-40be-ab4d-ae95302c73ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada132d5-7c60-40be-ab4d-ae95302c73ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807f1ef1-34e5-433a-8956-6fb376bb86f9', 'volume_name': 'volume-807f1ef1-34e5-433a-8956-6fb376bb86f9', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b88c06-c2ac-44ac-ba69-42bbdee91e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b88c06-c2ac-44ac-ba69-42bbdee91e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f587f92e-9716-453f-8f4b-7b05538633d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:26 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume 807f1ef1-34e5-433a-8956-6fb376bb86f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807f1ef1-34e5-433a-8956-6fb376bb86f9', 'volume_size': 1}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:26 devstack sudo[114321]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bb659c2d-ef4e-4dd5-9179-82985312f9fd" returned: 0 in 0.815s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:26 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-quobyte-bb659c2d-ef4e-4dd5-9179-82985312f9fd" released by "delete_volume" :: held 1.875s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Created reservations ['035c9756-8483-4367-8101-67610c9befa6', '0e45685d-b5e3-4527-a29b-a7d1a89b2a2e', '30352412-efb9-47e1-802a-4b5dbeb43cd7', '2dacadcc-fec6-456f-bd13-d51f09c6d090'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:27 devstack sudo[114328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:27 devstack sudo[114328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (a8dc7c7c-018b-44df-a1c7-df116cf43ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b80114-d0c2-4612-a241-199da6f8730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b80114-d0c2-4612-a241-199da6f8730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-697754331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf733b1-57c4-4a2e-9734-c4b82a34ba65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:27Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a62d82-6457-4d82-b83f-fa9e2fe9c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a62d82-6457-4d82-b83f-fa9e2fe9c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c0f62d-923f-4802-93d7-2cd422bff450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c0f62d-923f-4802-93d7-2cd422bff450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf733b1-57c4-4a2e-9734-c4b82a34ba65', 'volume_name': 'volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c45b925-3751-4cbf-828b-d690133e3595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c45b925-3751-4cbf-828b-d690133e3595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b222c947-ae08-4d84-b5e3-fe371feb2bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:27 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume 3bf733b1-57c4-4a2e-9734-c4b82a34ba65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65', 'volume_size': 1}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:27 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f" returned: 0 in 0.923s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e116ca72-e2b6-46cc-b922-a28e5c395109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Creating direct copy from snapshot {{(pid=93470) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[12855880-46cf-4061-82e6-34c935b4f091]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:27 devstack sudo[114333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109
Jun 24 04:37:27 devstack sudo[114333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:27 devstack sudo[114328]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.759s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:27 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Deleted volume successfully.
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2055c623-adef-48ac-977c-2f4e01bceb12 tempest-SnapshotDependencyTests-2019949350 None] Lock "cinder-bb659c2d-ef4e-4dd5-9179-82985312f9fd-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:27 devstack cinder-volume[93470]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93470) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Flow 'volume_create_manager' (f9e16aa8-08fb-4751-80e4-3f8825bb0ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ed4a9b-469d-4e17-9951-abea75be0bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ed4a9b-469d-4e17-9951-abea75be0bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1181283101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3395f6-faab-48c9-bf0d-c7f421bce077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566ba819b3b74c73a576385cd2e169cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:28Z,use_quota=True,user_id='dc93816f6da04bfe9085092305d50043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5cf9a2-e2cc-4fcb-9ae2-d1bfa38035f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5cf9a2-e2cc-4fcb-9ae2-d1bfa38035f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00b6c7c-0037-4897-9566-f12768f29a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00b6c7c-0037-4897-9566-f12768f29a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3395f6-faab-48c9-bf0d-c7f421bce077', 'volume_name': 'volume-bf3395f6-faab-48c9-bf0d-c7f421bce077', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22152640-84f8-4b82-b3f8-09da6d8664c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22152640-84f8-4b82-b3f8-09da6d8664c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d98227-7825-4837-acd6-22f9a17663b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:28 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Volume bf3395f6-faab-48c9-bf0d-c7f421bce077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3395f6-faab-48c9-bf0d-c7f421bce077', 'volume_size': 1}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:28 devstack sudo[114333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109" returned: 0 in 0.966s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG cinder.utils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Path /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4 not found in is_blk_device check {{(pid=93470) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:37:28 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:28 devstack sudo[114340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4
Jun 24 04:37:28 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:34 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4" returned: 0 in 5.739s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:34 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b283d9b-6f1c-487b-8d29-d5f797ee459b]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:34 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:34 devstack sudo[114354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109
Jun 24 04:37:34 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:35 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109" returned: 0 in 0.944s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.image.image_utils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Image conversion details: src /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4 {{(pid=93470) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:37:35 devstack cinder-volume[93470]: INFO cinder.image.image_utils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Converted 1024.00 MB image at 178.41 MB/s
Jun 24 04:37:35 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4 is being set with open permissions: ugo+rw
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:35 devstack sudo[114359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4
Jun 24 04:37:35 devstack sudo[114359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:35 devstack sudo[114359]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4" returned: 0 in 0.656s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-31482c6a-0610-4252-ad0a-ee1e045dabf4" released by "_copy_volume_from_snapshot" :: held 9.378s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-2a5c1ffb-c711-49fd-a08c-7d11947afc3f-31482c6a-0610-4252-ad0a-ee1e045dabf4" released by "_create_volume_from_snapshot" :: held 9.432s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.467s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.134s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893123306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e861b84f-a931-47c1-8ba6-98ca87fe1896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:26Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Creating volume e861b84f-a931-47c1-8ba6-98ca87fe1896 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:35 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:35 devstack sudo[114363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896 1073741824
Jun 24 04:37:35 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba9d1ff-34fe-4e74-9005-79f6d01e4689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31482c6a-0610-4252-ad0a-ee1e045dabf4', 'volume_size': 1, 'snapshot_id': '2a5c1ffb-c711-49fd-a08c-7d11947afc3f'}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed86449-311d-466d-b656-7d63579d5120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:35 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Volume volume-31482c6a-0610-4252-ad0a-ee1e045dabf4 (31482c6a-0610-4252-ad0a-ee1e045dabf4): created successfully
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed86449-311d-466d-b656-7d63579d5120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:35 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Flow 'volume_create_manager' (88570538-ea34-4d45-b680-be3df7988697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:35 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-44c91084-1bee-452e-b86d-2036898f83f0 tempest-VolumeDependencyTests-1155910176 None] Created volume successfully.
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-2a5c1ffb-c711-49fd-a08c-7d11947afc3f-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-2a5c1ffb-c711-49fd-a08c-7d11947afc3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-quobyte-e116ca72-e2b6-46cc-b922-a28e5c395109" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-e116ca72-e2b6-46cc-b922-a28e5c395109" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-quobyte-2a5c1ffb-c711-49fd-a08c-7d11947afc3f" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-2a5c1ffb-c711-49fd-a08c-7d11947afc3f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Deleting offline snapshot 2a5c1ffb-c711-49fd-a08c-7d11947afc3f of volume e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] snapshot_file for this snap is: volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[332acb71-e569-401c-8020-9144bbceddb4]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:36 devstack sudo[114365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f
Jun 24 04:37:36 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:36 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896 1073741824" returned: 0 in 1.069s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:36 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:37 devstack sudo[114371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896
Jun 24 04:37:37 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:37 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f" returned: 0 in 0.951s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e116ca72-e2b6-46cc-b922-a28e5c395109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f6eec7-8303-4d00-a2d8-66a9ab735942]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:37 devstack sudo[114376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109
Jun 24 04:37:37 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:37 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896" returned: 0 in 0.746s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.739s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1312633332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3851a5a2-7693-4aae-95d1-5b2d28b6c2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:26Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Creating volume 3851a5a2-7693-4aae-95d1-5b2d28b6c2ec {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:37 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d45491-fcc6-4ab6-ba44-5548d32c06bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e861b84f-a931-47c1-8ba6-98ca87fe1896', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7403c771-69f9-4be7-ad60-2b158c1e38e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:37 devstack sudo[114380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec 1073741824
Jun 24 04:37:37 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:37 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume volume-e861b84f-a931-47c1-8ba6-98ca87fe1896 (e861b84f-a931-47c1-8ba6-98ca87fe1896): created successfully
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7403c771-69f9-4be7-ad60-2b158c1e38e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:37 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (aedc45c1-bfad-4159-a45e-41776d17e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:37 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-daebb367-a1d0-4cd3-b8ce-0c1366d0d044 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created volume successfully.
Jun 24 04:37:38 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109" returned: 0 in 0.889s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:38 devstack sudo[114386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f
Jun 24 04:37:38 devstack sudo[114386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:38 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec 1073741824" returned: 0 in 1.007s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:38 devstack sudo[114394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec
Jun 24 04:37:38 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:38 devstack sudo[114386]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f" returned: 0 in 0.821s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:38 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:39 devstack sudo[114396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f
Jun 24 04:37:39 devstack sudo[114396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:39 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec" returned: 0 in 0.704s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.141s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-193356142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fa89e1-8836-480b-b613-e5abbd290cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:26Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Creating volume f7fa89e1-8836-480b-b613-e5abbd290cd7 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:39 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:39 devstack sudo[114400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7 1073741824
Jun 24 04:37:39 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad25ead5-7cd5-4545-adbb-d33de2b4e05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93104517-7f19-460d-944a-44bfe581d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:39 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec (3851a5a2-7693-4aae-95d1-5b2d28b6c2ec): created successfully
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93104517-7f19-460d-944a-44bfe581d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (7fd8f1f3-86b9-46b2-8ef0-b8bc801bec89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:39 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f12620e3-0e54-4fac-8e2c-961b964df9bb tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created volume successfully.
Jun 24 04:37:39 devstack sudo[114396]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109.2a5c1ffb-c711-49fd-a08c-7d11947afc3f" returned: 0 in 0.704s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-2a5c1ffb-c711-49fd-a08c-7d11947afc3f" released by "_delete_snapshot" :: held 3.491s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-e116ca72-e2b6-46cc-b922-a28e5c395109" released by "delete_snapshot" :: held 3.519s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Created reservations ['e25b3ef3-9326-4bf6-9c11-b1357fe36edd', 'e299dae1-c1f6-4dd3-81b5-16dc29bd5694', '1c064d14-854d-485b-8da6-084110f28927', '33e5ff41-4de3-4c2a-b455-512762b0cefc'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:39 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Delete snapshot completed successfully.
Jun 24 04:37:39 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-dee7c5e6-8257-415e-b8df-8757901613e3 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-2a5c1ffb-c711-49fd-a08c-7d11947afc3f-delete_snapshot" released by "delete_snapshot" :: held 3.681s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:40 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7 1073741824" returned: 0 in 0.897s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-e116ca72-e2b6-46cc-b922-a28e5c395109-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-e116ca72-e2b6-46cc-b922-a28e5c395109-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:40 devstack sudo[114406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7
Jun 24 04:37:40 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-quobyte-e116ca72-e2b6-46cc-b922-a28e5c395109" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:40 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-e116ca72-e2b6-46cc-b922-a28e5c395109" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:40 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab20d649-ac03-4737-b29f-9737a7dc2be3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:40 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:40 devstack sudo[114408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109
Jun 24 04:37:40 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:41 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7" returned: 0 in 0.637s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.232s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-772832736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807f1ef1-34e5-433a-8956-6fb376bb86f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:27Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Creating volume 807f1ef1-34e5-433a-8956-6fb376bb86f9 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:41 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5b808d-7d66-4b89-9584-e282a226d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fa89e1-8836-480b-b613-e5abbd290cd7', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:41 devstack sudo[114411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9 1073741824
Jun 24 04:37:41 devstack sudo[114411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97ddc81-047d-44cb-b680-afeb81a8f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:41 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume volume-f7fa89e1-8836-480b-b613-e5abbd290cd7 (f7fa89e1-8836-480b-b613-e5abbd290cd7): created successfully
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97ddc81-047d-44cb-b680-afeb81a8f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (71bca2ab-b1cf-48d3-89c0-8ecdf5ed401c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:41 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-335b6991-bc7a-49bd-8a24-fb2681ef948f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created volume successfully.
Jun 24 04:37:41 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109" returned: 0 in 0.755s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:41 devstack sudo[114416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109
Jun 24 04:37:41 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:41 devstack sudo[114411]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9 1073741824" returned: 0 in 0.790s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:41 devstack sudo[114422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9
Jun 24 04:37:41 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:41 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:41 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e116ca72-e2b6-46cc-b922-a28e5c395109" returned: 0 in 0.669s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-e116ca72-e2b6-46cc-b922-a28e5c395109" released by "delete_volume" :: held 1.497s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Created reservations ['253506d8-7e60-424a-a3a0-7b3101d13b09', '4ee95c9a-671f-414b-8676-0d51332c2686', '6d7434df-a116-403d-8125-8db288673912', '8b1d4c04-c54c-47a8-968b-ecdb19974f26'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:42 devstack sudo[114424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:42 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:42 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9" returned: 0 in 0.685s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.365s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-697754331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf733b1-57c4-4a2e-9734-c4b82a34ba65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3206af2546804fc6a47c25dacbf488da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:27Z,use_quota=True,user_id='e2cef00e465e437b9c96b52cdc1e8575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Creating volume 3bf733b1-57c4-4a2e-9734-c4b82a34ba65 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:42 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:42 devstack sudo[114427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65 1073741824
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f587f92e-9716-453f-8f4b-7b05538633d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807f1ef1-34e5-433a-8956-6fb376bb86f9', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:42 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8eb17d-e35c-4be8-aa13-2ea52144f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-31482c6a-0610-4252-ad0a-ee1e045dabf4-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:42 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume volume-807f1ef1-34e5-433a-8956-6fb376bb86f9 (807f1ef1-34e5-433a-8956-6fb376bb86f9): created successfully
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8eb17d-e35c-4be8-aa13-2ea52144f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (ed313f2f-e052-4ff9-8771-b341cd52d5de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-31482c6a-0610-4252-ad0a-ee1e045dabf4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-438293d6-8cbc-4d19-8737-2fb5dfd2dccf tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created volume successfully.
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "cinder-quobyte-31482c6a-0610-4252-ad0a-ee1e045dabf4" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-31482c6a-0610-4252-ad0a-ee1e045dabf4" acquired by "delete_volume" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0e0b06-fe4f-4c38-b917-61ebcc429cc3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:42 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.731s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:42 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Deleted volume successfully.
Jun 24 04:37:42 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-34613422-4460-42d1-a8fa-16e1a3f809f0 tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-e116ca72-e2b6-46cc-b922-a28e5c395109-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:42 devstack sudo[114430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4
Jun 24 04:37:42 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:43 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65 1073741824" returned: 0 in 0.826s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:43 devstack sudo[114438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65
Jun 24 04:37:43 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:43 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4" returned: 0 in 0.787s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:43 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:43 devstack sudo[114440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4
Jun 24 04:37:43 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:44 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65" returned: 0 in 0.686s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.139s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ceb77db27b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:37:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1181283101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3395f6-faab-48c9-bf0d-c7f421bce077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566ba819b3b74c73a576385cd2e169cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:37:28Z,use_quota=True,user_id='dc93816f6da04bfe9085092305d50043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88fe5a4-8314-4159-ac29-6f176a1a251d),volume_type_id=b88fe5a4-8314-4159-ac29-6f176a1a251d)}" {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Creating volume bf3395f6-faab-48c9-bf0d-c7f421bce077 {{(pid=93470) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Selected osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90 as target Quobyte volume. {{(pid=93470) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:37:44 devstack cinder-volume[93470]: INFO cinder.volume.drivers.remotefs [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] casted to osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 1073741824 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b222c947-ae08-4d84-b5e3-fe371feb2bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:44 devstack sudo[114444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 1073741824
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f333a4-2189-435b-b846-cbae847144b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:44 devstack sudo[114444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:44 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-31482c6a-0610-4252-ad0a-ee1e045dabf4" returned: 0 in 0.656s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:44 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Volume volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65 (3bf733b1-57c4-4a2e-9734-c4b82a34ba65): created successfully
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f333a4-2189-435b-b846-cbae847144b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Flow 'volume_create_manager' (a8dc7c7c-018b-44df-a1c7-df116cf43ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-quobyte-31482c6a-0610-4252-ad0a-ee1e045dabf4" released by "delete_volume" :: held 1.498s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:44 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-d3b13759-07a3-456e-b4c3-f8058d5dea17 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created volume successfully.
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Created reservations ['dfb7833f-07c0-49ca-a36c-c920e5496be0', '9fe7f227-3236-4cc4-bb57-3e5652907744', 'd6247167-74a2-4c17-afb3-a2c7ca5c0c1c', '4ff6b663-c139-4651-b7b5-4d0f3aa9a36b'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:44 devstack sudo[114446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:44 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-3bf733b1-57c4-4a2e-9734-c4b82a34ba65-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-3bf733b1-57c4-4a2e-9734-c4b82a34ba65-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-quobyte-3bf733b1-57c4-4a2e-9734-c4b82a34ba65" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-3bf733b1-57c4-4a2e-9734-c4b82a34ba65" acquired by "delete_volume" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff9df6-6821-4246-a4a1-b098d875d955]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:44 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:45 devstack sudo[114452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65
Jun 24 04:37:45 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:45 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.685s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:45 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Deleted volume successfully.
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-79663c78-faf1-46ce-a905-ee71934e9f8c tempest-VolumeDependencyTests-1155910176 None] Lock "cinder-31482c6a-0610-4252-ad0a-ee1e045dabf4-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:45 devstack sudo[114444]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 1073741824" returned: 0 in 0.935s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:45 devstack sudo[114455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077
Jun 24 04:37:45 devstack sudo[114455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:45 devstack sudo[114457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:45 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:45 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65" returned: 0 in 0.870s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:45 devstack sudo[114464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65
Jun 24 04:37:45 devstack sudo[114464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:45 devstack sudo[114455]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077" returned: 0 in 0.785s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'} {{(pid=93470) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:37:45 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d98227-7825-4837-acd6-22f9a17663b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3395f6-faab-48c9-bf0d-c7f421bce077', 'volume_size': 1}' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ba5ee3-4c8a-4b78-be1f-9fc49e9277e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:37:46 devstack cinder-volume[93470]: INFO cinder.volume.flows.manager.create_volume [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Volume volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 (bf3395f6-faab-48c9-bf0d-c7f421bce077): created successfully
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ba5ee3-4c8a-4b78-be1f-9fc49e9277e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93470) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:37:46 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Flow 'volume_create_manager' (f9e16aa8-08fb-4751-80e4-3f8825bb0ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93470) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.720s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_service.periodic_task [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] Running periodic task VolumeManager._thread_info {{(pid=93470) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread count: 28 {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.manager [None req-2c465b4d-9687-4f5a-b6a1-f02ce6479806 None None] thread info: [<_MainThread(MainThread, started 137350873133184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137350766183424)>, <Thread(Thread-3 (stat_writer), started daemon 137350760271936)>, <Thread(Rabbit-heartbeat, started daemon 137350761311680)>, <Thread(Thread-5 (_runner), started daemon 137350761141952)>, <Thread(Thread-7 (_runner), started daemon 137350761154112)>, <Thread(fd_logger, started daemon 137350758830464)>, <Thread(privsep_reader, started daemon 137350760141888)>, <Thread(tpool_thread_0, started daemon 137350749656768)>, <Thread(tpool_thread_1, started daemon 137350741264064)>, <Thread(tpool_thread_2, started daemon 137350732871360)>, <Thread(tpool_thread_3, started daemon 137350724478656)>, <Thread(tpool_thread_4, started daemon 137350716085952)>, <Thread(tpool_thread_5, started daemon 137350707693248)>, <Thread(tpool_thread_6, started daemon 137350699300544)>, <Thread(tpool_thread_7, started daemon 137350690907840)>, <Thread(tpool_thread_8, started daemon 137350682515136)>, <Thread(tpool_thread_9, started daemon 137350674122432)>, <Thread(tpool_thread_10, started daemon 137350665729728)>, <Thread(tpool_thread_11, started daemon 137350657337024)>, <Thread(tpool_thread_12, started daemon 137350648944320)>, <Thread(tpool_thread_13, started daemon 137350640551616)>, <Thread(tpool_thread_14, started daemon 137350632158912)>, <Thread(tpool_thread_15, started daemon 137350623749824)>, <Thread(tpool_thread_16, started daemon 137350615340736)>, <Thread(tpool_thread_17, started daemon 137350606931648)>, <Thread(tpool_thread_18, started daemon 137350598522560)>, <Thread(tpool_thread_19, started daemon 137350590113472)>] {{(pid=93470) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:37:46 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-e2202824-5f2b-4f94-bbcd-e046b2cbd6b3 tempest-CinderUnicodeTest-686188375 None] Created volume successfully.
Jun 24 04:37:46 devstack sudo[114464]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3bf733b1-57c4-4a2e-9734-c4b82a34ba65" returned: 0 in 0.820s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-3bf733b1-57c4-4a2e-9734-c4b82a34ba65" released by "delete_volume" :: held 1.752s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Creating offline snapshot 2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 of volume bf3395f6-faab-48c9-bf0d-c7f421bce077 {{(pid=93470) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created reservations ['b18c4efd-632f-4f05-88ea-c26def227180', '94b88982-64d2-4aef-b4b5-76922efc25a5', 'da5484ec-fed7-4494-9a34-1b67416464e6', '43a8a7df-d10b-4abc-a724-ff05f95981d3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e33a6d5-e3f5-415e-9f30-59d3f9d558fc]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:46 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:46 devstack sudo[114470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:46 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:46 devstack sudo[114469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077
Jun 24 04:37:46 devstack sudo[114469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-807f1ef1-34e5-433a-8956-6fb376bb86f9-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-807f1ef1-34e5-433a-8956-6fb376bb86f9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-quobyte-807f1ef1-34e5-433a-8956-6fb376bb86f9" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-807f1ef1-34e5-433a-8956-6fb376bb86f9" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[043ee471-8d73-4f26-a0ed-045de8d3ca65]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:47 devstack sudo[114473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9
Jun 24 04:37:47 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:47 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.706s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:47 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Deleted volume successfully.
Jun 24 04:37:47 devstack sudo[114469]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077" returned: 0 in 0.823s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 1G {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31bbf642-33aa-43ac-b812-a7f42319fcbc tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-3bf733b1-57c4-4a2e-9734-c4b82a34ba65-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:47 devstack sudo[114479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 1G
Jun 24 04:37:47 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:47 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9" returned: 0 in 0.764s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:47 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:48 devstack sudo[114484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9
Jun 24 04:37:48 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:48 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 1G" returned: 0 in 0.807s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:48 devstack sudo[114489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4
Jun 24 04:37:48 devstack sudo[114489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:48 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-807f1ef1-34e5-433a-8956-6fb376bb86f9" returned: 0 in 0.662s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-807f1ef1-34e5-433a-8956-6fb376bb86f9" released by "delete_volume" :: held 1.475s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created reservations ['b2317282-4af8-4d45-a83e-919b924c04ad', 'e52b5970-1fa6-4755-890b-49a967800886', '6be1abba-6e3d-4ad1-817a-3ddc4528ee8e', 'e0a2dbe8-21a8-4ddc-8a17-3714277ba23a'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:48 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:48 devstack sudo[114492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:48 devstack sudo[114492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:49 devstack sudo[114489]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 -F qcow2 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4" returned: 0 in 0.690s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:49 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 is being set with open permissions: ugo+rw
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:49 devstack sudo[114497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4
Jun 24 04:37:49 devstack sudo[114497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-f7fa89e1-8836-480b-b613-e5abbd290cd7-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-f7fa89e1-8836-480b-b613-e5abbd290cd7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-quobyte-f7fa89e1-8836-480b-b613-e5abbd290cd7" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:49 devstack sudo[114492]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.672s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-f7fa89e1-8836-480b-b613-e5abbd290cd7" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:49 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Deleted volume successfully.
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44bb430-1926-44c9-9bcf-9825fe408c73]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-f0071d0c-bebe-4f6f-a8ff-b5eba8c6c24a tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-807f1ef1-34e5-433a-8956-6fb376bb86f9-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:49 devstack sudo[114500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7
Jun 24 04:37:49 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:49 devstack sudo[114497]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4" returned: 0 in 0.660s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:49 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:49 devstack sudo[114503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.info
Jun 24 04:37:49 devstack sudo[114503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:50 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7" returned: 0 in 0.763s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:50 devstack sudo[114508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7
Jun 24 04:37:50 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:50 devstack sudo[114503]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.info" returned: 0 in 0.666s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:50 devstack cinder-volume[93470]: WARNING cinder.volume.drivers.remotefs [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.info is being set with open permissions: ugo+rw
Jun 24 04:37:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.info {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:50 devstack sudo[114511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.info
Jun 24 04:37:50 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:50 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:50 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-f7fa89e1-8836-480b-b613-e5abbd290cd7" returned: 0 in 0.656s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:50 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-f7fa89e1-8836-480b-b613-e5abbd290cd7" released by "delete_volume" :: held 1.471s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:50 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created reservations ['ae250925-6f50-4cca-b8ee-3c2ef464e78c', '867d6792-2b19-4c8a-8ccd-8005753ec306', '4dc97188-d788-4aca-abfa-eaa6825b5823', '3da69a5b-8a35-4582-ab52-79d6ca975abf'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:51 devstack sudo[114515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:51 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:51 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.info" returned: 0 in 0.675s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.421s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-61a397d7-7248-4016-9979-663206f825da tempest-CinderUnicodeTest-686188375 None] Create snapshot completed successfully
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-quobyte-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec" acquired by "delete_volume" :: waited 0.015s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:51 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.665s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:51 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Deleted volume successfully.
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[76717187-43b7-43ff-b125-188073bc4091]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2e314db7-9349-4a02-b73c-99b90f61865f tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-f7fa89e1-8836-480b-b613-e5abbd290cd7-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:51 devstack sudo[114518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec
Jun 24 04:37:51 devstack sudo[114518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Acquiring lock "cinder-2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4-delete_snapshot" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Acquiring lock "cinder-quobyte-bf3395f6-faab-48c9-bf0d-c7f421bce077" by "delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-quobyte-bf3395f6-faab-48c9-bf0d-c7f421bce077" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:51 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Acquiring lock "cinder-quobyte-2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4" by "_delete_snapshot" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-quobyte-2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Deleting offline snapshot 2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 of volume bf3395f6-faab-48c9-bf0d-c7f421bce077 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] snapshot_file for this snap is: volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 {{(pid=93470) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b90874-7b06-478c-b6d1-cbfea43c2263]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:52 devstack sudo[114520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4
Jun 24 04:37:52 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:52 devstack sudo[114518]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec" returned: 0 in 0.791s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:52 devstack sudo[114526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec
Jun 24 04:37:52 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:52 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4" returned: 0 in 0.766s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.remotefs [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf3395f6-faab-48c9-bf0d-c7f421bce077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93470) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f707c300-8595-4b55-a994-3e3a006a336e]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:52 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:52 devstack sudo[114531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077
Jun 24 04:37:52 devstack sudo[114531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:53 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec" returned: 0 in 0.654s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec" released by "delete_volume" :: held 1.508s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created reservations ['9e067fd6-7203-418a-b8df-ce42b531b3e7', '0985c6b5-3f04-4b57-a11a-91fc2d4b5680', 'f4384cd4-f7c2-4780-b302-796a18966d42', 'b1ee95de-2fa3-4153-9896-5022137159bc'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:53 devstack sudo[114534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:53 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:53 devstack sudo[114531]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077" returned: 0 in 0.755s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:53 devstack sudo[114539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4
Jun 24 04:37:53 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-e861b84f-a931-47c1-8ba6-98ca87fe1896-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-e861b84f-a931-47c1-8ba6-98ca87fe1896-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-quobyte-e861b84f-a931-47c1-8ba6-98ca87fe1896" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-e861b84f-a931-47c1-8ba6-98ca87fe1896" acquired by "delete_volume" :: waited 0.025s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fca43d-0dbe-443f-9673-c161f43b761a]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:53 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:53 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.659s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:54 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:54 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Deleted volume successfully.
Jun 24 04:37:54 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-2d3fc5b5-a6bb-42d9-9326-c1d537a10507 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-3851a5a2-7693-4aae-95d1-5b2d28b6c2ec-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:54 devstack sudo[114542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896
Jun 24 04:37:54 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:54 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4" returned: 0 in 0.737s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:54 devstack sudo[114547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4
Jun 24 04:37:54 devstack sudo[114547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:54 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896" returned: 0 in 0.727s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:54 devstack sudo[114552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896
Jun 24 04:37:54 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:54 devstack sudo[114547]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:54 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077.2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4" returned: 0 in 0.638s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-quobyte-2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4" released by "_delete_snapshot" :: held 3.021s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-quobyte-bf3395f6-faab-48c9-bf0d-c7f421bce077" released by "delete_snapshot" :: held 3.044s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Created reservations ['ed3537d9-60f1-46b2-8731-e9e1abc6be05', '070e4a34-08d6-4226-b70d-d4389c0e2f6b', '4381143e-3655-418b-9390-4372f31f123b', 'e79f583c-7b86-42bd-9b09-1522ea74645c'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:55 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Delete snapshot completed successfully.
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-a9d17073-efcf-4cd3-bd06-009d1eb7ccd6 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-2dd532a9-6f98-4acb-8f6a-7d3ff3a8d6c4-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:55 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-e861b84f-a931-47c1-8ba6-98ca87fe1896" returned: 0 in 0.627s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-e861b84f-a931-47c1-8ba6-98ca87fe1896" released by "delete_volume" :: held 1.393s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created reservations ['443075c2-8f89-4f22-902f-f5068e70ca7e', '4b7505cf-f080-4da5-88a1-6f38ef969817', '1fc7adf8-f44d-4ff3-9423-dd9377a80779', 'aa9d1d37-f538-4190-9c25-a3a0d5b2f6d3'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:55 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:55 devstack sudo[114556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:55 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:56 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.646s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:56 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Deleted volume successfully.
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-ac9d3e48-3478-4849-8fc5-479391139fbe tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-e861b84f-a931-47c1-8ba6-98ca87fe1896-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-aacd79d4-16bd-497e-a971-aca11848754a-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-aacd79d4-16bd-497e-a971-aca11848754a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "cinder-quobyte-aacd79d4-16bd-497e-a971-aca11848754a" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Acquiring lock "cinder-bf3395f6-faab-48c9-bf0d-c7f421bce077-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-aacd79d4-16bd-497e-a971-aca11848754a" acquired by "delete_volume" :: waited 0.022s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b2528d-20dd-49cd-99d9-31ef39f71688]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-bf3395f6-faab-48c9-bf0d-c7f421bce077-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Acquiring lock "cinder-quobyte-bf3395f6-faab-48c9-bf0d-c7f421bce077" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-quobyte-bf3395f6-faab-48c9-bf0d-c7f421bce077" acquired by "delete_volume" :: waited 0.013s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e63405f-2cfb-4aa3-b1f9-4433fcb912a3]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:56 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:56 devstack sudo[114565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a
Jun 24 04:37:56 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:56 devstack sudo[114566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077
Jun 24 04:37:56 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:57 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a" returned: 0 in 0.778s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:57 devstack sudo[114576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a
Jun 24 04:37:57 devstack sudo[114576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:57 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077" returned: 0 in 0.763s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:57 devstack sudo[114578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077
Jun 24 04:37:57 devstack sudo[114578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:57 devstack sudo[114576]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-aacd79d4-16bd-497e-a971-aca11848754a" returned: 0 in 0.636s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-quobyte-aacd79d4-16bd-497e-a971-aca11848754a" released by "delete_volume" :: held 1.454s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Created reservations ['66db8ef8-d6f1-4087-8c35-f19884480e8f', '7d466e3b-90cd-4e41-9596-0f91392aee3c', '0e77638f-bcb0-47fa-a0a3-d3a6e019884d', '8bdb42f4-9ce2-4e5f-8037-eb0b5952c4fb'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:57 devstack sudo[114578]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-bf3395f6-faab-48c9-bf0d-c7f421bce077" returned: 0 in 0.644s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-quobyte-bf3395f6-faab-48c9-bf0d-c7f421bce077" released by "delete_volume" :: held 1.465s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:57 devstack sudo[114582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:57 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Created reservations ['4958645c-d5dd-4053-8dae-f68e8f90f2d9', '62040b17-bedd-4468-b9a4-6e8fc93628d2', 'b423e0f8-4c25-44ba-aea9-32f91545dcfe', '6c5c3bad-b1fe-430d-b7fc-10035e198a51'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:37:57 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:57 devstack sudo[114584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:37:57 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Acquiring lock "cinder-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3-delete_volume" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Lock "cinder-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:58 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.705s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:58 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Deleted volume successfully.
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-31205a01-4917-42aa-9242-d64dab9b3022 tempest-CreateVolumesFromSourceVolumeTest-44000814 None] Lock "cinder-aacd79d4-16bd-497e-a971-aca11848754a-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Acquiring lock "cinder-quobyte-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3" by "delete_volume" {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Lock "cinder-quobyte-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3" acquired by "delete_volume" :: waited 0.014s {{(pid=93470) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG oslo.privsep.daemon [-] privsep: reply[36aafd62-4bc9-4061-83ab-6f8419481626]: (4, 'qcow2') {{(pid=94826) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:58 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.701s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:37:58 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Deleted volume successfully.
Jun 24 04:37:58 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-c268ceea-6b51-47d7-8b03-9c40bb074278 tempest-CinderUnicodeTest-686188375 None] Lock "cinder-bf3395f6-faab-48c9-bf0d-c7f421bce077-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:37:58 devstack sudo[114588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3
Jun 24 04:37:58 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:37:59 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root
Jun 24 04:37:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3" returned: 0 in 0.808s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:37:59 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:37:59 devstack sudo[114593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3
Jun 24 04:37:59 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:38:00 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32/volume-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3" returned: 0 in 0.682s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Lock "cinder-quobyte-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3" released by "delete_volume" :: held 1.533s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG cinder.quota [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Created reservations ['1ff02929-77db-4100-85d7-67d6e41d59a2', 'ba1684e4-f140-4145-98e2-3cd3bc2dc77b', '78746fcc-8deb-4095-adad-3800f0588fa0', '01a95037-e24b-4a4d-b030-cf4bf9972b61'] {{(pid=93470) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90': None} {{(pid=93470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG cinder.volume.drivers.quobyte [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3302b669-0a56-4079-9214-5c5fa6559b90'] {{(pid=93470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.lockutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32 {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:38:00 devstack sudo[114596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32
Jun 24 04:38:00 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:38:00 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG oslo_concurrency.processutils [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/961c329a6aee058002dd53921412fe32" returned: 0 in 0.647s {{(pid=93470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG cinder.manager [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Notifying Schedulers of capabilities ... {{(pid=93470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:38:00 devstack cinder-volume[93470]: INFO cinder.volume.manager [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Deleted volume successfully.
Jun 24 04:38:00 devstack cinder-volume[93470]: DEBUG cinder.coordination [None req-773abe16-e604-4ac2-ba20-9f0b289c7c7a tempest-CinderUnicodeTest-686188375 None] Lock "cinder-6de38d50-c3d1-4a6b-b16d-4a9b63ba92b3-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=93470) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:38:10 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=102,cinder:INSERT=33,cinder:UPDATE=148,cinder:DELETE=8 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:38:10 devstack cinder-volume[93470]: DEBUG dbcounter [-] [93470] Writing DB stats cinder:SELECT=98,cinder:INSERT=37,cinder:UPDATE=134,cinder:DELETE=15 {{(pid=93470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}